-- Logs begin at Tue 2022-06-21 09:17:44 UTC, end at Tue 2022-06-21 10:17:28 UTC. -- Jun 21 09:50:08.416505 dv-cinder-806605-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 09:50:08.423844 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 09:50:08 2022] *** Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: nodename: dv-cinder-806605-4-iscsi Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: machine: x86_64 Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: clock source: unix Jun 21 09:50:08.425936 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: pcre jit disabled Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: detected number of CPU cores: 4 Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: current working directory: / Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: detected binary path: /usr/bin/uwsgi-core Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: your processes number limit is 47680 Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: your memory page size is 4096 bytes Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: detected max file descriptor number: 2048 Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: lock engine: pthread robust mutexes Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: thunder lock: enabled Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 09:50:08.426417 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 09:50:08.471110 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: Python main interpreter initialized at 0x56414aa169c0 Jun 21 09:50:08.471110 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: python threads support enabled Jun 21 09:50:08.471110 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: your server socket listen backlog is limited to 100 connections Jun 21 09:50:08.471110 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: your mercy for graceful operations on workers is 90 seconds Jun 21 09:50:08.471492 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 09:50:08.471568 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: *** Operational MODE: preforking *** Jun 21 09:50:08.471819 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: *** uWSGI is running in multiple interpreter mode *** Jun 21 09:50:08.471819 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: spawned uWSGI master process (pid: 103005) Jun 21 09:50:08.472043 dv-cinder-806605-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 09:50:08.472603 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: spawned uWSGI worker 1 (pid: 103006, cores: 1) Jun 21 09:50:08.472935 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: spawned uWSGI worker 2 (pid: 103007, cores: 1) Jun 21 09:50:08.473099 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 09:50:09.125549 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 09:50:09.130063 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 09:50:10.241009 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:50:10.241009 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: from cryptography.utils import int_from_bytes Jun 21 09:50:10.241587 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:50:10.241587 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: from cryptography.utils import int_from_bytes Jun 21 09:50:10.242011 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:50:10.242011 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: from cryptography.utils import int_from_bytes Jun 21 09:50:10.242125 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:50:10.242125 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: from cryptography.utils import int_from_bytes Jun 21 09:50:12.703355 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 09:50:12.703909 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 09:50:12.704151 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 09:50:12.704508 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 09:50:12.704768 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 09:50:12.705040 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 09:50:12.705434 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.705534 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 09:50:12.705626 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.705766 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.705854 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 09:50:12.706082 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.706182 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 09:50:12.706388 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 09:50:12.706475 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.706702 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.706796 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707018 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707119 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707332 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707420 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707653 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707741 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.707909 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.708044 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.708263 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.708360 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.708588 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-4-iscsi {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.708671 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.708909 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709006 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709211 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709298 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709602 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709828 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.709914 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.710130 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.710237 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-4-iscsi {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.710447 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.710558 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.710751 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.710842 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.711058 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.711238 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.711371 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.711674 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.711787 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.711996 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.712153 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.712291 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.712440 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.712621 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.712794 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.712929 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.713102 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.713234 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.713406 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.713552 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.713719 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.713855 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714049 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714186 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714360 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714474 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714666 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714879 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-4-iscsi {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.714980 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.715192 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.715278 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.715501 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.715588 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.715811 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.715898 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.716241 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.716330 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-4-iscsi {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.716550 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.716651 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.716858 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.716966 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.717175 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.717271 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.717492 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.717578 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.717797 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.717883 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.718120 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.718220 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.718436 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.718522 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.718754 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.718875 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.719070 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.719160 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.719370 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.719457 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.719675 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.719772 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720011 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720114 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720318 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720425 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720619 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.720920 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721006 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721167 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721270 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721472 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721585 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721788 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.721876 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722104 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722199 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722351 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722438 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722655 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722751 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722902 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.722993 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.723215 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.723311 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.723532 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.723640 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.723823 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.723925 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.724122 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.724212 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.724441 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.724539 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.724763 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.724869 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.725064 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.725150 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.725365 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.725451 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.725669 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.725757 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.726237 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.726336 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.726542 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.726628 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.726847 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.726936 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.727152 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.727245 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.727456 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.727549 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.727771 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.727864 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.728108 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.728213 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.728424 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.728511 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.728727 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.728813 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729046 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729144 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729361 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729457 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729733 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729867 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.729986 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.730073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.730325 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.730491 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.730644 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.730733 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.730946 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731031 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731250 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731346 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731565 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731653 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731869 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.731963 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.732201 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.732301 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.732447 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.732534 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.732743 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.732830 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733046 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733137 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733359 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733446 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733660 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733757 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.733957 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734046 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734256 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734343 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734557 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734645 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734862 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.734950 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.735167 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.735253 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.735466 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.735559 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.735765 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.735852 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736085 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736176 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736387 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736474 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736691 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736779 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.736991 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737075 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737289 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737384 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737588 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737673 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737894 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.737980 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.738193 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.738286 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.738493 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.738589 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.738792 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.738895 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.739093 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.739195 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.739406 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740037 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740252 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740350 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740552 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740646 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740871 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.740968 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.741156 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.741249 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.741455 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.741554 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.741759 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.741845 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742059 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742153 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742360 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742456 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742660 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742745 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.742956 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.743048 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.743260 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.743358 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.743561 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.743647 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.743862 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744079 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744210 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744331 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744474 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744588 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744773 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.744894 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745079 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745176 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745373 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745495 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745667 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745766 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.745964 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746051 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746257 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746345 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746555 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746641 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746856 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.746944 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.747154 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.747240 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.747453 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.747546 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.747750 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.747836 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.748088 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.748194 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.748395 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.748493 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.748702 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.748796 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.749005 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.749107 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.749324 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:50:12.749431 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.749656 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.749742 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.749979 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.750072 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.750294 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.750394 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.750606 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.750713 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.750915 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751003 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751235 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751325 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751541 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751628 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751847 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.751934 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.752176 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.752275 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.752490 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.752579 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.752802 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.752887 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.753112 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.753198 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.753421 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.753537 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.753732 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.753821 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754044 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754133 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754350 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754439 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754661 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754748 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.754973 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.755060 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.755854 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.755953 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.756191 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.756298 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.756508 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.756598 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.756838 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.756934 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.757158 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.757252 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.757470 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.757558 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.757804 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.757889 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.758111 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.758211 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.758416 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.758504 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.758724 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.758812 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759042 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759157 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759352 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759441 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759660 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759747 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.759969 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.760088 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.760311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.760396 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.760618 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.760706 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.760925 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761030 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761233 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761328 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761541 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761628 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761851 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.761938 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.762161 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.762247 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.762471 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.762568 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.762779 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.762868 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.763092 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.763179 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.763399 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.763486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.763705 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.763793 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764029 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764159 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764333 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764432 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764631 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764720 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.764931 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765018 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765242 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765339 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765541 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765628 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765844 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.765929 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.766151 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.766246 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.766453 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.766538 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.766755 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.766848 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767068 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767163 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767375 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767463 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767682 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767776 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.767996 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.768169 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.768313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.768401 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.768621 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.768708 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.768926 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769013 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769226 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769351 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769531 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769624 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769838 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.769926 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.770140 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.770227 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.770443 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.770538 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.770770 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.770905 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.771082 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.771169 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.771385 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.771471 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.771690 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.771778 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772022 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772111 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772333 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772431 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772636 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772729 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.772945 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773031 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773251 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773345 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773559 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773647 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773872 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.773959 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.774287 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.774384 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.774498 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.774573 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.774812 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.774908 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.775132 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.775227 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.775444 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.775532 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.775746 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.775833 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776075 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776177 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776378 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776466 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776677 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776772 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.776978 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777067 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777367 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777579 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777668 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777879 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.777974 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.778176 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.778264 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.778475 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.778562 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.778772 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.778865 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779072 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779165 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779376 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779473 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779674 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779762 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.779983 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.780087 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.780296 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.780396 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.780614 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.780702 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.780919 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781052 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781223 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781319 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781527 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781613 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781868 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.781966 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.782171 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.782272 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.782482 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.782581 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.782794 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.782882 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.783101 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.783236 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.783409 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.783497 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.783716 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.783806 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784046 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784139 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784365 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784488 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784674 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784760 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.784981 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.785069 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.785291 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.785377 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.785608 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.785694 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.785914 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786001 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786228 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786315 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786555 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786641 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786868 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.786956 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.787175 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.787270 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.787494 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.787590 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.787800 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.787887 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.788139 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.788239 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.788445 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.788540 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.788757 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.788844 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789064 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789152 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789370 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789466 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789678 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789776 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.789985 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.790073 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.790303 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.790398 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.790613 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.790700 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.790924 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791011 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791228 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791318 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791542 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791635 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791847 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.791940 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.792187 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.792279 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.792484 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.792593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.792793 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.792887 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.793101 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.793188 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.793419 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.793514 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.793724 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.793810 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794033 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794121 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794350 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794437 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794655 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794750 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.794958 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795047 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795271 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795368 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795572 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795669 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795872 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.795960 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.796201 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.796289 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.796510 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.796675 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.796813 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.796900 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.797116 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.797201 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.797418 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.797519 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.797728 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.797815 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798031 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798118 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798330 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798427 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798629 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798716 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.798935 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799029 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799241 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799328 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799547 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799674 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799852 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.799938 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.800186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.800276 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.800488 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.800574 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.800789 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.800876 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.801106 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.801239 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.801412 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.801506 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.801714 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.801810 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.802526 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.802628 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.802839 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.802933 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.803156 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.803250 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.803463 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.803550 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.803762 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.803855 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.804092 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.804196 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.804411 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.804498 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.804717 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.804804 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805026 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805122 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805337 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805436 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805644 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805732 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.805953 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806047 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806262 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806347 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806567 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806654 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806874 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.806970 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.807182 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.807269 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.807489 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.807581 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.807793 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.807880 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.808141 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.808231 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.808450 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.808537 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.808761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.808850 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809069 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809158 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809374 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809461 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809682 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809816 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.809997 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.810083 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.810307 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.810566 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.810661 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.810902 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.810989 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.811215 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.811344 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.811534 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.811783 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.811870 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.812144 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.812247 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.812463 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.812559 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.812783 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.812884 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.813107 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.813194 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.813427 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.813528 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.813745 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.813832 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814053 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814144 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814356 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814444 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814667 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814772 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.814974 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.815070 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.815283 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.815371 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.815586 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.815682 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.815894 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816005 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816218 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816315 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816519 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816615 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816821 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.816914 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.817123 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.817210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.817425 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.817512 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.818273 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.818374 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.818585 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.818672 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.818891 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.818979 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.819204 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.819290 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.819511 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.819598 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.819817 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.819906 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.820141 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.820242 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.820445 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.820534 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.820757 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.820852 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.821063 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.821150 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.821366 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.821531 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.821669 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.821756 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822011 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822098 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822316 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822417 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822617 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822704 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.822937 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823025 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823239 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823339 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823539 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823633 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823840 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.823927 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.824170 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.824279 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.824476 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.824570 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.824776 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.824872 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825083 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825172 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825389 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825482 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825693 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825780 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.825994 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826081 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826292 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826378 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826597 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826691 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826899 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.826994 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.827205 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.827301 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.827506 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.827592 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.827806 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.827894 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.828130 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.828220 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.828438 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.828538 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.828742 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.828836 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829044 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829129 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829347 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829451 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829646 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829732 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.829953 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830045 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830252 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830347 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830552 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830641 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830851 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.830937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.831156 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.831252 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.831458 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.831591 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.831756 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.831843 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832079 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832172 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832390 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832478 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832689 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832775 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.832989 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.833084 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.833315 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.833432 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.833621 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.833743 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.833921 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834021 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834226 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834329 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834529 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834623 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834835 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.834924 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.835135 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.835224 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.835440 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.835536 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.835739 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.835826 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836065 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836156 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836370 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836474 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836675 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836772 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.836978 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837071 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837278 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837383 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837579 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837665 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837878 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.837964 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.838178 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.838279 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.838481 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.838575 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.838786 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.838876 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.839093 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.839182 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.839393 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.839488 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.839695 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.839783 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840053 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840149 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840354 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840453 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840677 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840763 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.840981 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.841076 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.841293 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.841388 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.841607 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.841695 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.841916 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842005 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842224 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842314 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842532 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842630 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842831 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.842919 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.843141 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.843228 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.843447 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.843543 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.843757 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.843843 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844074 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844164 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844376 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844476 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844692 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844780 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.844997 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.845083 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.845301 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.845426 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.845602 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.845691 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.845919 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846005 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846227 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846321 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846527 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846613 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846829 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.846916 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.847136 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.847225 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.847441 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.847527 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.847745 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.847832 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.848071 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.848164 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.848379 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.848466 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.848684 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.848770 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849012 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849106 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849317 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849402 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849621 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849707 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.849922 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.850013 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.850226 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.850320 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.850529 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.850625 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.850830 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.851190 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.851395 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.851482 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.851702 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.851798 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852018 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852107 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852325 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852412 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852625 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852725 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.852930 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853017 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853229 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853318 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853533 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853650 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853839 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.853959 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.854152 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.854265 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.854455 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.854565 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.854869 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.854962 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.855179 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.855266 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.855488 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.855575 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.855790 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.855875 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.856116 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.856219 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.856426 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.856534 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.856740 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.856835 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.857051 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.857138 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.857355 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.857443 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.857712 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.857893 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858014 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858111 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858320 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858416 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858640 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858735 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.858940 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859036 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859240 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859326 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859540 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859625 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859858 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.859952 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.860179 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.860300 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.860480 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.860568 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.860786 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.860883 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.861108 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.861195 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.861412 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.861499 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.861731 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.861855 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.862145 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.862239 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.862454 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.862541 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.862754 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.862841 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.863077 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.863171 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.863397 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.863484 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.863696 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.863785 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.864026 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.864117 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.864334 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865018 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865180 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865270 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865501 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865812 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.865898 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.866119 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.866207 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.866417 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.866506 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.866738 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.866826 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867045 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867139 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867355 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867442 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867656 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867743 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.867990 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.868098 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.868321 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.868409 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.868633 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.868722 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.868954 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.869054 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.869312 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.869399 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.869617 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.869712 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.869919 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870008 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870226 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870321 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870528 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870619 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870829 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.870918 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.871146 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.871234 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.871447 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.871534 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.871755 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.871844 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.872083 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.872176 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.872409 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.872497 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.872715 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.872812 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873021 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873108 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873330 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873416 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873629 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873716 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.873931 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874017 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874238 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874335 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874553 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874639 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874854 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.874947 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.875157 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.875253 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.875474 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.875562 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.875785 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.875879 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.876114 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.876217 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.876417 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.876505 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.876717 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.876813 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877033 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877128 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877340 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877435 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877644 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877731 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.877946 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878034 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878279 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878366 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878583 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878668 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878903 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.878992 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.879221 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.879307 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.879534 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.879628 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.879849 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.879944 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.880243 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.880866 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881052 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881154 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881357 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881446 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881665 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881753 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.881972 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882101 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882275 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882385 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882578 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882676 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882886 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.882991 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.883186 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.883281 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.883485 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.883590 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.883787 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.883890 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.884120 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.884222 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.884421 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.884516 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.884727 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.884822 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885030 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885126 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885332 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885428 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885636 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885749 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.885944 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886034 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886249 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886336 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886554 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886651 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886859 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.886948 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.887165 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.887252 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.887491 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.887580 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.887799 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.887885 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.888136 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.888241 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.888459 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.888548 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.888774 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.888869 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.889089 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.889249 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.889399 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.889487 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.889710 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.889798 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890024 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890184 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890337 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890424 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890648 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890734 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.890955 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.891052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.891269 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.891355 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.891578 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.891665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.891893 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.892008 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.892249 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.892426 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.892553 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.892753 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.892852 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.893070 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.893180 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.893381 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.893672 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.893778 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.893988 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.894085 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.894300 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.894406 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.894609 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.894706 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.894917 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895015 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895222 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895333 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895531 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895644 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895863 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.895960 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.896203 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.896292 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.896514 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.896614 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.896825 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.896921 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.897140 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.897236 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.897451 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.897549 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.897763 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.897851 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.898072 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.898160 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.898397 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.898491 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.898712 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.898813 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899014 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899112 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899324 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899414 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899636 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899723 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.899947 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900118 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900278 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900367 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900585 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900674 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900896 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.900993 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.901205 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.901297 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.901513 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.901601 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.901819 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.901924 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.902130 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.902233 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.902441 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.902540 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.902746 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.902834 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.903058 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.903154 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.903372 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.903462 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.903680 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.903769 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904009 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904113 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904326 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904427 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904661 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904833 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.904976 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.905144 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.905289 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.905476 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.905611 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.905804 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.906124 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.906212 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.906434 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.906532 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.906747 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.906835 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907069 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907167 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907372 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907473 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907672 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907761 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.907989 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.908081 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.908299 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.908400 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.908601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.908690 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.908914 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909000 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909218 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909306 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909518 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909606 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909819 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.909905 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.910127 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.910218 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.910435 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.910654 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.910743 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911001 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911103 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911315 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911405 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911665 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911878 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.911998 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.912249 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.912337 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.912565 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.912661 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.912893 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.912990 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.913212 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.913306 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.913518 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.913606 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.913822 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.913918 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.914129 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.914216 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.914431 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.914543 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.914734 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.914832 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915042 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915146 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915348 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915443 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915652 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915789 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.915953 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.916102 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.916282 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.916371 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.916581 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.916670 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.916892 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917007 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917193 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917291 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917493 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917591 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917802 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.917900 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.918106 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.918211 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.918409 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.918515 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.918709 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.918806 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919010 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919185 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919313 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919412 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919612 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919707 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.919914 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920059 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920239 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920327 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920548 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920647 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920848 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.920949 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.921154 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.921242 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.921458 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.921546 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.921770 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.921866 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922073 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922162 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922382 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922470 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922692 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922787 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.922999 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.923095 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.923319 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.923415 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.923619 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.923707 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.923925 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.924031 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.924260 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.924347 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.924587 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.924675 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.924896 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.925110 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.925199 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.925439 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.925536 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.925763 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.925900 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.926090 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.926351 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.926452 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.926690 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.926777 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.927509 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.927604 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.927817 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.927914 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.928163 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.928253 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.928472 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.928563 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.928781 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.928878 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.929088 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.929176 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.929395 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.929482 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.929701 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.929798 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930006 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930094 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930310 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930398 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930617 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930707 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.930923 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931012 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931227 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931314 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931534 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931629 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931837 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.931924 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.932171 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.932270 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.932481 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.932569 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.932789 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.932877 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.933099 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.933200 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.933410 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.933506 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.933722 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.933811 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934034 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934133 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934341 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934436 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934647 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934734 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.934952 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.935054 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.935256 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.935344 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.935567 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.935662 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.935891 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936077 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936227 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936317 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936526 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936614 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936840 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.936929 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.937171 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.937259 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.937488 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.937582 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.937794 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.937883 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.938148 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.938234 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.938468 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.938566 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.938786 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.938874 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.939095 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.939184 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.939413 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.939509 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.939722 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.939818 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.940068 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.940172 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.940381 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.940483 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.940704 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.940799 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941015 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941102 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941317 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941406 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941621 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941709 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.941922 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.942017 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.942227 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.942318 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.942543 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.942630 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.943401 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.943493 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.943703 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.943792 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944027 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944121 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944338 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944426 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944641 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944732 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.944941 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945030 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945242 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945341 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945543 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945844 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.945988 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.946142 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.946241 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.946444 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.946549 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.946740 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.946833 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947039 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947140 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947338 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947427 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947636 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947725 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.947934 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948090 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948258 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948346 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948557 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948646 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948856 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.948948 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.949154 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.949242 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.949452 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.949540 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.949754 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.949841 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950057 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950144 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950359 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950446 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950663 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950752 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.950986 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.951072 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.951304 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.951391 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.951609 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.951699 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.951927 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952034 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952261 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952360 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952570 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952657 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952874 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.952963 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.953193 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.953288 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.953540 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.953642 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.953807 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.953896 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.954112 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.954211 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.954418 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.954506 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.954725 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.954813 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955032 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955129 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955346 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955432 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955657 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955744 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.955957 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.956126 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.956287 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.956376 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.956607 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.956698 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.956924 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957014 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957228 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957321 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957534 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957620 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957858 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.957946 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.958164 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.958278 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.958494 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.958595 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.958803 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.958898 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.959109 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.959196 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.959416 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.959518 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.959728 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.959823 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960064 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960156 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960377 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960477 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960689 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960777 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.960994 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.961080 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.961308 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.961395 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.961630 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.961716 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.961954 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.962040 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.962265 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.962354 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.962592 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.962679 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.962915 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963008 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963228 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963317 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963537 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963839 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.963927 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.964102 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 09:50:12.964228 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.964546 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.964858 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.965169 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:50:12.965409 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 09:50:13.118648 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO dbcounter [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Registered counter for database nova_api Jun 21 09:50:13.118777 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO dbcounter [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Registered counter for database nova_api Jun 21 09:50:13.138594 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_db.sqlalchemy.engines [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.140115 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_db.sqlalchemy.engines [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.145516 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writer thread running {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.146690 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writer thread running {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.205069 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.context [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12bd7c28-46c5-4e5d-900d-cb840c6e27b8(cell1) {{(pid=103007) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 09:50:13.205260 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.context [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12bd7c28-46c5-4e5d-900d-cb840c6e27b8(cell1) {{(pid=103006) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 09:50:13.208959 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:50:13.209141 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_concurrency.lockutils [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:50:13.210580 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:50:13.210686 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_concurrency.lockutils [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:50:13.211373 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:50:13.211465 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_concurrency.lockutils [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:50:13.213341 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:50:13.213445 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_concurrency.lockutils [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:50:13.215318 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO dbcounter [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Registered counter for database nova_cell0 Jun 21 09:50:13.215421 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO dbcounter [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Registered counter for database nova_cell0 Jun 21 09:50:13.219387 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO dbcounter [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Registered counter for database nova_cell1 Jun 21 09:50:13.219516 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO dbcounter [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Registered counter for database nova_cell1 Jun 21 09:50:13.227872 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_db.sqlalchemy.engines [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.229403 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_db.sqlalchemy.engines [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.232542 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_db.sqlalchemy.engines [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.233187 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writer thread running {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.233882 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_db.sqlalchemy.engines [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.236107 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writer thread running {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.378584 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writer thread running {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.388691 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO dbcounter [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Registered counter for database nova_cell0 Jun 21 09:50:13.395359 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG oslo_db.sqlalchemy.engines [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.397547 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writer thread running {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.400526 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writer thread running {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.406891 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO dbcounter [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Registered counter for database nova_cell0 Jun 21 09:50:13.414517 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_db.sqlalchemy.engines [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:50:13.418931 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writer thread running {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:50:13.737166 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: WARNING keystonemiddleware.auth_token [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:50:13.740850 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: WARNING keystonemiddleware.auth_token [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:50:13.744432 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: WARNING keystonemiddleware.auth_token [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:50:13.748219 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: WARNING keystonemiddleware.auth_token [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:50:14.084892 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: WARNING keystonemiddleware.auth_token [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:50:14.090780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: WARNING keystonemiddleware.auth_token [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:50:14.092867 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: WARNING keystonemiddleware.auth_token [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:50:14.096122 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56414aa169c0 pid: 103007 (default app) Jun 21 09:50:14.098211 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:50:14.098805 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: WARNING keystonemiddleware.auth_token [None req-495378c4-7f4a-4856-ae26-f12c9f331bcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:50:14.099433 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001796 Jun 21 09:50:14.099837 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Jun 21 09:50:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:50:14.104408 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56414aa169c0 pid: 103006 (default app) Jun 21 09:51:28.299560 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:28.300660 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 21 09:51:28.301045 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:28.317529 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writing DB stats nova_api:SELECT=3 {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:28.318639 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writing DB stats nova_cell0:SELECT=3 {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:28.319477 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writing DB stats nova_cell1:SELECT=3 {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:28.320313 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:28.740996 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-6117640f-96a7-45ef-9f81-b9cd07c0559e admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:28.769795 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-6117640f-96a7-45ef-9f81-b9cd07c0559e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461418 Jun 21 09:51:28.771346 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 09:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:30.831614 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:30.832648 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-f85611dc-0809-4e8a-9ecf-4b404b7b656c None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 21 09:51:30.833218 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:30.892252 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-d58dea1a-008c-49ae-b2e9-54597ca5ad7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:30.910271 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:51:30.910271 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: warnings.warn(msg) Jun 21 09:51:30.938697 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-d58dea1a-008c-49ae-b2e9-54597ca5ad7c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099849 Jun 21 09:51:30.939465 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:51:30.952989 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_api:SELECT=3 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:30.954136 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_cell0:SELECT=3 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:30.955117 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_cell1:SELECT=3 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:30.956114 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_cell0:SELECT=3 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:31.159342 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-96def95e-5add-41df-a240-ec0b34c5f015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:31.161808 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:51:31.161808 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: warnings.warn(msg) Jun 21 09:51:31.232579 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-96def95e-5add-41df-a240-ec0b34c5f015 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284579 Jun 21 09:51:31.236430 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 09:51:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:33.313022 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-d58dea1a-008c-49ae-b2e9-54597ca5ad7c admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:33.313962 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-d58dea1a-008c-49ae-b2e9-54597ca5ad7c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 21 09:51:33.314404 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:33.419835 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-d2022fb6-06ce-49a7-95d6-cc004fd46b82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "ram": 512, "swap": 0}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:33.437453 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:51:33.437453 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: warnings.warn(msg) Jun 21 09:51:33.456108 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-d2022fb6-06ce-49a7-95d6-cc004fd46b82 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134848 Jun 21 09:51:33.456659 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 09:51:33.468999 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-09765496-9f86-4c6f-9eb8-54e25d8221cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:33.470480 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:51:33.470480 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: warnings.warn(msg) Jun 21 09:51:33.502354 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-09765496-9f86-4c6f-9eb8-54e25d8221cc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036880 Jun 21 09:51:33.503052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 09:51:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:35.568618 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-d2022fb6-06ce-49a7-95d6-cc004fd46b82 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:35.570277 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-d2022fb6-06ce-49a7-95d6-cc004fd46b82 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Jun 21 09:51:35.570857 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:35.632931 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-12b520ae-fb95-4528-93c1-49c9cb5ed0f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "disk": 10}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:35.651660 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-12b520ae-fb95-4528-93c1-49c9cb5ed0f2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074174 Jun 21 09:51:35.652927 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:51:35.665445 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-f35ce31f-5fd2-42f3-bf3b-80e02e81664d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:35.689247 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-f35ce31f-5fd2-42f3-bf3b-80e02e81664d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027973 Jun 21 09:51:35.696192 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 09:51:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:37.807401 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-12b520ae-fb95-4528-93c1-49c9cb5ed0f2 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:37.808408 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-12b520ae-fb95-4528-93c1-49c9cb5ed0f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 21 09:51:37.808799 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:37.868780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b03d687e-2c43-4575-8d86-89e900a7df08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:37.886357 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-b03d687e-2c43-4575-8d86-89e900a7df08 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072048 Jun 21 09:51:37.887111 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:51:37.898884 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-aead4efc-e10b-4973-99c4-777cfc964170 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:37.920720 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-aead4efc-e10b-4973-99c4-777cfc964170 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025561 Jun 21 09:51:37.921286 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 09:51:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:51:39.985432 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b03d687e-2c43-4575-8d86-89e900a7df08 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:39.986436 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-b03d687e-2c43-4575-8d86-89e900a7df08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 21 09:51:39.987001 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:40.043180 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-a8ffe8dc-14f5-48b6-b0d2-f0d91721f6ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:40.061374 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-a8ffe8dc-14f5-48b6-b0d2-f0d91721f6ec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068347 Jun 21 09:51:40.062096 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:51:40.073941 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-c5ca13cf-c19a-4bff-84db-c8de4a6a43fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:40.096823 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-c5ca13cf-c19a-4bff-84db-c8de4a6a43fb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026506 Jun 21 09:51:40.097522 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 21 09:51:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:42.185205 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-a8ffe8dc-14f5-48b6-b0d2-f0d91721f6ec admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:42.186220 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-a8ffe8dc-14f5-48b6-b0d2-f0d91721f6ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 21 09:51:42.186613 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:42.250384 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-eaecbf8d-54bd-4480-b6e2-fb13e7293064 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:42.274895 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-eaecbf8d-54bd-4480-b6e2-fb13e7293064 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082264 Jun 21 09:51:42.275666 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 09:51:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:51:44.373997 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-a8ffe8dc-14f5-48b6-b0d2-f0d91721f6ec admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:44.375271 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-a8ffe8dc-14f5-48b6-b0d2-f0d91721f6ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jun 21 09:51:44.375745 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:44.435733 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-ef38cb19-114b-432f-86a5-ac240e2533d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:44.454529 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-ef38cb19-114b-432f-86a5-ac240e2533d3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071772 Jun 21 09:51:44.455103 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:51:44.467601 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-af5016f7-e9eb-490e-ba55-99767c987ba2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:44.490665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-af5016f7-e9eb-490e-ba55-99767c987ba2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026742 Jun 21 09:51:44.491252 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 09:51:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:46.554384 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-ef38cb19-114b-432f-86a5-ac240e2533d3 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:46.555434 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-ef38cb19-114b-432f-86a5-ac240e2533d3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 21 09:51:46.555831 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:46.625815 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-5c19f478-52b2-4d27-9899-fff466778919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:46.644152 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-5c19f478-52b2-4d27-9899-fff466778919 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081274 Jun 21 09:51:46.644698 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 09:51:46.660240 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-3c1f8921-2c04-406a-a6ab-94f69c80519e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:46.687701 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-3c1f8921-2c04-406a-a6ab-94f69c80519e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032160 Jun 21 09:51:46.688446 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 09:51:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:48.819905 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-5c19f478-52b2-4d27-9899-fff466778919 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:48.820946 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-5c19f478-52b2-4d27-9899-fff466778919 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 21 09:51:48.821345 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:48.886308 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-8d84bff3-8fa2-43fb-9fb0-257cd90c4f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:48.905491 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-8d84bff3-8fa2-43fb-9fb0-257cd90c4f76 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076689 Jun 21 09:51:48.906357 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:51:48.920513 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-9802a07a-a686-4f01-86d0-0c8ed81ff519 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:48.942464 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-9802a07a-a686-4f01-86d0-0c8ed81ff519 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025613 Jun 21 09:51:48.943031 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 09:51:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:51:50.982035 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-8d84bff3-8fa2-43fb-9fb0-257cd90c4f76 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:50.983069 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-8d84bff3-8fa2-43fb-9fb0-257cd90c4f76 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 21 09:51:50.983468 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:51.043232 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-4a8c751d-38ef-4b95-8113-f0e704c56d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:51.061537 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-4a8c751d-38ef-4b95-8113-f0e704c56d07 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072193 Jun 21 09:51:51.062077 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 09:51:51.074315 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-309f72c3-fe8e-443e-ae1c-b0ea2a1ec7f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:51.098455 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-309f72c3-fe8e-443e-ae1c-b0ea2a1ec7f3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027708 Jun 21 09:51:51.099682 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 09:51:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:51:53.164888 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-4a8c751d-38ef-4b95-8113-f0e704c56d07 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:51:53.165922 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-4a8c751d-38ef-4b95-8113-f0e704c56d07 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 21 09:51:53.166306 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:51:53.224383 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-a7a86ba8-6ca7-45aa-8943-11e28630fdd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:53.241516 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-a7a86ba8-6ca7-45aa-8943-11e28630fdd2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.069255 Jun 21 09:51:53.242092 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 21 09:51:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 09:51:53.254214 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-0bfcc113-aff3-4127-b0e2-78eaaed59efd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:51:53.276429 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-0bfcc113-aff3-4127-b0e2-78eaaed59efd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026065 Jun 21 09:51:53.276997 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 21 09:51:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:52:17.921712 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-a7a86ba8-6ca7-45aa-8943-11e28630fdd2 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:17.922715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-a7a86ba8-6ca7-45aa-8943-11e28630fdd2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 21 09:52:17.923110 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:17.933707 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:17.982569 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-5f7fd322-c7f7-46f0-bd41-bfb9c25e41d1 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:17.999157 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-5f7fd322-c7f7-46f0-bd41-bfb9c25e41d1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070020 Jun 21 09:52:17.999681 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 09:52:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:52:18.906531 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-a7a86ba8-6ca7-45aa-8943-11e28630fdd2 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:18.907536 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-a7a86ba8-6ca7-45aa-8943-11e28630fdd2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 21 09:52:18.907928 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:19.095849 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2b76483-ecb7-4058-bb68-37ab1e2721f8 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:19.101927 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.wsgi [None req-f2b76483-ecb7-4058-bb68-37ab1e2721f8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2b76483-ecb7-4058-bb68-37ab1e2721f8 admin admin] Request method failure captured: Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Accept: application/json Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Accept-Encoding: gzip, deflate Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Connection: keep-alive Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Content-Length: 0 Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Host: 10.222.0.36 Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Openstack-Api-Version: compute 2.90 Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Openstack-System-Scope: None Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: User-Agent: python-novaclient Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Auth-Token: gAAAAABisZTSPZdcr9YJGYvnweAA6Z8ah6sfK-tSloU69qpl0hz3Kpsbp8ZvP3xg9aoPhmAVKw4MaaZq39hD-_xHdbEEyQHtBoO4Sapf-x3139cs3MEMgC0d7eysBxFFrQAH9F3pi56QVm5cfqQYCk7Vw34Khv72qbh_a-fdYLP2W3xfRjzt4kg Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Domain-Id: None Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Domain-Name: None Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Identity-Status: Confirmed Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Is-Admin-Project: True Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Domain-Id: default Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Domain-Name: Default Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Name: admin Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Role: admin,reader,member Jun 21 09:52:19.105517 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Roles: admin,reader,member Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f168e0b349b4ecc9d941ccf0785ad5d"}]}] Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant: admin Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant-Name: admin Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User: admin Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Domain-Id: default Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Domain-Name: Default Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Id: 80104af4696c44369cc93327cb4e59bd Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Name: admin Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: method: > Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: exception: Flavor 42 could not be found. Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: action_args: {'id': '42'} Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:52:19.107178 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:19.108258 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.109728 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2b76483-ecb7-4058-bb68-37ab1e2721f8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:52:19.111022 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2b76483-ecb7-4058-bb68-37ab1e2721f8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062533 Jun 21 09:52:19.111022 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 09:52:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:19.116729 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-57ad9ffd-0e12-467a-89bf-736b92006d18 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:19.119614 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:19.139384 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-57ad9ffd-0e12-467a-89bf-736b92006d18 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026268 Jun 21 09:52:19.139904 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 09:52:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 09:52:19.149976 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-11242133-e77c-4fd0-8e68-8c55dc382672 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:19.171877 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-11242133-e77c-4fd0-8e68-8c55dc382672 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025395 Jun 21 09:52:19.172441 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 09:52:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:52:19.181542 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-84509baa-dc03-4b99-90e7-275726dce1b2 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:19.187808 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.wsgi [None req-84509baa-dc03-4b99-90e7-275726dce1b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-84509baa-dc03-4b99-90e7-275726dce1b2 admin admin] Request method failure captured: Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Accept: application/json Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Accept-Encoding: gzip, deflate Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Connection: keep-alive Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Content-Length: 0 Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Host: 10.222.0.36 Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Openstack-Api-Version: compute 2.90 Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Openstack-System-Scope: None Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: User-Agent: python-novaclient Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Auth-Token: gAAAAABisZTSPZdcr9YJGYvnweAA6Z8ah6sfK-tSloU69qpl0hz3Kpsbp8ZvP3xg9aoPhmAVKw4MaaZq39hD-_xHdbEEyQHtBoO4Sapf-x3139cs3MEMgC0d7eysBxFFrQAH9F3pi56QVm5cfqQYCk7Vw34Khv72qbh_a-fdYLP2W3xfRjzt4kg Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Domain-Id: None Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Domain-Name: None Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Identity-Status: Confirmed Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Is-Admin-Project: True Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Domain-Id: default Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Domain-Name: Default Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Name: admin Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Role: admin,reader,member Jun 21 09:52:19.191073 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Roles: admin,reader,member Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f168e0b349b4ecc9d941ccf0785ad5d"}]}] Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant: admin Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant-Name: admin Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User: admin Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Domain-Id: default Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Domain-Name: Default Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Id: 80104af4696c44369cc93327cb4e59bd Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Name: admin Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: method: > Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: exception: Flavor 42 could not be found. Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: action_args: {'id': '42'} Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:52:19.193281 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:19.194311 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:19.195586 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-84509baa-dc03-4b99-90e7-275726dce1b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:52:19.196869 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-84509baa-dc03-4b99-90e7-275726dce1b2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014988 Jun 21 09:52:19.196869 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 09:52:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 09:52:20.000991 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-11242133-e77c-4fd0-8e68-8c55dc382672 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:20.001991 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-11242133-e77c-4fd0-8e68-8c55dc382672 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 21 09:52:20.002382 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:20.191484 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b8695a0b-d4d9-425d-8b23-cd1dad0d671c admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:20.197261 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.wsgi [None req-b8695a0b-d4d9-425d-8b23-cd1dad0d671c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b8695a0b-d4d9-425d-8b23-cd1dad0d671c admin admin] Request method failure captured: Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Accept: application/json Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Accept-Encoding: gzip, deflate Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Connection: keep-alive Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Content-Length: 0 Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Host: 10.222.0.36 Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Openstack-Api-Version: compute 2.90 Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Openstack-System-Scope: None Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: User-Agent: python-novaclient Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Auth-Token: gAAAAABisZTTXLtZU2wPazlgtSaL-wlkcbjfMzwBO823wC1lEO3CZKKtpGkinMzTK9HnxR1RyyZLe67jleSjqBWmZTrnE5EnqmDV81UD84gVxJFx9wfSvTnKS7614vWLAWpWPgkBtFBQP72W7PW39JwPXtp3J7WP0cP8dKkSMycGldBdTt3uPgE Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Domain-Id: None Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Domain-Name: None Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Identity-Status: Confirmed Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Is-Admin-Project: True Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Domain-Id: default Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Domain-Name: Default Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Name: admin Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Role: admin,reader,member Jun 21 09:52:20.198761 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Roles: admin,reader,member Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f168e0b349b4ecc9d941ccf0785ad5d"}]}] Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant: admin Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant-Name: admin Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User: admin Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Domain-Id: default Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Domain-Name: Default Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Id: 80104af4696c44369cc93327cb4e59bd Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Name: admin Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: method: > Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: exception: Flavor 84 could not be found. Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: action_args: {'id': '84'} Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:52:20.200322 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:20.201313 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.202601 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b8695a0b-d4d9-425d-8b23-cd1dad0d671c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:52:20.203844 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-b8695a0b-d4d9-425d-8b23-cd1dad0d671c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060385 Jun 21 09:52:20.203844 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 09:52:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:20.210363 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-8c4af843-ac00-48af-a587-ef7ae1321af4 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:20.224440 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-8c4af843-ac00-48af-a587-ef7ae1321af4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018161 Jun 21 09:52:20.224968 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 09:52:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 09:52:20.234296 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-0dfef310-3eed-4753-98d3-675de8b16211 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:20.249201 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-0dfef310-3eed-4753-98d3-675de8b16211 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018332 Jun 21 09:52:20.249714 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 09:52:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:52:20.258749 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-ad9b36bc-da94-4486-8c60-2fff05a35cee admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:20.264175 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.wsgi [None req-ad9b36bc-da94-4486-8c60-2fff05a35cee admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-ad9b36bc-da94-4486-8c60-2fff05a35cee admin admin] Request method failure captured: Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Accept: application/json Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Accept-Encoding: gzip, deflate Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Connection: keep-alive Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Content-Length: 0 Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Host: 10.222.0.36 Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Openstack-Api-Version: compute 2.90 Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Openstack-System-Scope: None Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: User-Agent: python-novaclient Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Auth-Token: gAAAAABisZTTXLtZU2wPazlgtSaL-wlkcbjfMzwBO823wC1lEO3CZKKtpGkinMzTK9HnxR1RyyZLe67jleSjqBWmZTrnE5EnqmDV81UD84gVxJFx9wfSvTnKS7614vWLAWpWPgkBtFBQP72W7PW39JwPXtp3J7WP0cP8dKkSMycGldBdTt3uPgE Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Domain-Id: None Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Domain-Name: None Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Identity-Status: Confirmed Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Is-Admin-Project: True Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Domain-Id: default Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Domain-Name: Default Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Name: admin Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Role: admin,reader,member Jun 21 09:52:20.265665 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Roles: admin,reader,member Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f168e0b349b4ecc9d941ccf0785ad5d"}]}] Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant: admin Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant-Name: admin Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User: admin Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Domain-Id: default Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Domain-Name: Default Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Id: 80104af4696c44369cc93327cb4e59bd Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Name: admin Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: method: > Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: exception: Flavor 84 could not be found. Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: action_args: {'id': '84'} Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:52:20.267210 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:20.268186 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:20.269486 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-ad9b36bc-da94-4486-8c60-2fff05a35cee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:52:20.271221 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-ad9b36bc-da94-4486-8c60-2fff05a35cee admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011757 Jun 21 09:52:20.271221 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 21 09:52:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:21.075303 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-0dfef310-3eed-4753-98d3-675de8b16211 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:21.076330 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-0dfef310-3eed-4753-98d3-675de8b16211 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 21 09:52:21.076726 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:21.266128 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-e77c88c7-de0f-4e7e-8838-204f55d930fd admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:21.272543 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.wsgi [None req-e77c88c7-de0f-4e7e-8838-204f55d930fd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-e77c88c7-de0f-4e7e-8838-204f55d930fd admin admin] Request method failure captured: Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Accept: application/json Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Accept-Encoding: gzip, deflate Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Connection: keep-alive Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Content-Length: 0 Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Host: 10.222.0.36 Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Openstack-Api-Version: compute 2.90 Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Openstack-System-Scope: None Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: User-Agent: python-novaclient Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Auth-Token: gAAAAABisZTVBSHk3wK8Dko6MtwyEnFgxYOCxbTzq3MNcFoRNkWmcc3TWVT15ny1V2Me2p4X687kk7lKsMBJ3xyVO3WS-lbvXC9zkTRij2sykZ-jrqHa2_wUvCgg5uAWsXTHBGk5_se8APu-expEH5mzDDVALW8WmmNusWofVoVcaTkukpW1BOc Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Domain-Id: None Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Domain-Name: None Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Identity-Status: Confirmed Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Is-Admin-Project: True Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Domain-Id: default Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Domain-Name: Default Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Project-Name: admin Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Role: admin,reader,member Jun 21 09:52:21.274052 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Roles: admin,reader,member Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f168e0b349b4ecc9d941ccf0785ad5d"}]}] Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant: admin Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-Tenant-Name: admin Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User: admin Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Domain-Id: default Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Domain-Name: Default Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Id: 80104af4696c44369cc93327cb4e59bd Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: X-User-Name: admin Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: method: > Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: exception: Flavor 451 could not be found. Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: action_args: {'id': '451'} Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:52:21.275593 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:21.276631 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.277937 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-e77c88c7-de0f-4e7e-8838-204f55d930fd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:52:21.279201 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-e77c88c7-de0f-4e7e-8838-204f55d930fd admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061150 Jun 21 09:52:21.279201 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 09:52:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:21.284912 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-f42972e6-df14-43c6-9555-f12af07c1d83 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:21.298400 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-f42972e6-df14-43c6-9555-f12af07c1d83 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017004 Jun 21 09:52:21.298849 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 09:52:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:52:21.307795 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:21.321509 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017139 Jun 21 09:52:21.322015 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 21 09:52:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:52:21.330781 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-91a11526-5ee2-4c89-9b95-a89651001f6e admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:21.337584 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.wsgi [None req-91a11526-5ee2-4c89-9b95-a89651001f6e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-91a11526-5ee2-4c89-9b95-a89651001f6e admin admin] Request method failure captured: Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Accept: application/json Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Accept-Encoding: gzip, deflate Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Connection: keep-alive Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Content-Length: 0 Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Host: 10.222.0.36 Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Openstack-Api-Version: compute 2.90 Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Openstack-System-Scope: None Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: User-Agent: python-novaclient Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Auth-Token: gAAAAABisZTVBSHk3wK8Dko6MtwyEnFgxYOCxbTzq3MNcFoRNkWmcc3TWVT15ny1V2Me2p4X687kk7lKsMBJ3xyVO3WS-lbvXC9zkTRij2sykZ-jrqHa2_wUvCgg5uAWsXTHBGk5_se8APu-expEH5mzDDVALW8WmmNusWofVoVcaTkukpW1BOc Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Domain-Id: None Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Domain-Name: None Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Identity-Status: Confirmed Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Is-Admin-Project: True Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Domain-Id: default Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Domain-Name: Default Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Project-Name: admin Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Role: admin,reader,member Jun 21 09:52:21.339159 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Roles: admin,reader,member Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f168e0b349b4ecc9d941ccf0785ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f168e0b349b4ecc9d941ccf0785ad5d"}]}] Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant: admin Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant-Id: 7f168e0b349b4ecc9d941ccf0785ad5d Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-Tenant-Name: admin Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User: admin Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Domain-Id: default Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Domain-Name: Default Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Id: 80104af4696c44369cc93327cb4e59bd Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: X-User-Name: admin Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: method: > Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: exception: Flavor 451 could not be found. Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: action_args: {'id': '451'} Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:52:21.340715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:21.341562 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: ERROR nova.api.openstack.wsgi Jun 21 09:52:21.342780 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-91a11526-5ee2-4c89-9b95-a89651001f6e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:52:21.344028 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-91a11526-5ee2-4c89-9b95-a89651001f6e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013231 Jun 21 09:52:21.344028 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 09:52:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 09:52:22.155322 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:22.156424 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 21 09:52:22.156891 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:22.346482 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-8166bb91-9680-4b42-80ab-a1321e543aae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:52:22.364818 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-8166bb91-9680-4b42-80ab-a1321e543aae admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069855 Jun 21 09:52:22.365320 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 09:52:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:52:23.189096 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:23.190139 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 21 09:52:23.190535 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:23.378619 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-51d20278-fa6b-498c-83b3-a6c2f493aaa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:52:23.395911 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-51d20278-fa6b-498c-83b3-a6c2f493aaa2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068466 Jun 21 09:52:23.396448 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 09:52:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:52:24.220040 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:24.221037 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 21 09:52:24.221447 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:24.412028 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-3e458d41-c62d-4a31-8714-ee81ad2fafbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:52:24.428715 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-3e458d41-c62d-4a31-8714-ee81ad2fafbb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069476 Jun 21 09:52:24.429250 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 09:52:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:52:25.245576 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:25.246572 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 21 09:52:25.246986 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:25.434751 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-7ce2a883-4ddd-4747-9695-c497f3355289 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:52:25.452413 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-7ce2a883-4ddd-4747-9695-c497f3355289 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068033 Jun 21 09:52:25.452933 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 21 09:52:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:52:26.266523 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:26.267525 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 21 09:52:26.267912 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:52:26.454808 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-7d01dff9-109b-4867-9b9d-d170a4fa021b admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:52:26.474434 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-7d01dff9-109b-4867-9b9d-d170a4fa021b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069610 Jun 21 09:52:26.474964 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Jun 21 09:52:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:53:12.966971 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:53:12.967968 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-f2568904-0553-42e9-8533-17daf556d2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 21 09:53:12.968379 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 21 09:53:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:53:12.978369 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:53:13.027236 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-af04a6be-2123-4c12-9674-f3219cc37326 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:53:13.046259 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-af04a6be-2123-4c12-9674-f3219cc37326 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072263 Jun 21 09:53:13.046783 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 21 09:53:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:53:13.070415 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-a95333ea-e90d-4917-98e5-71b0b5c58258 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:53:13.073864 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG dbcounter [-] [103006] Writing DB stats nova_api:SELECT=14 {{(pid=103006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:53:13.079557 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-a95333ea-e90d-4917-98e5-71b0b5c58258 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013377 Jun 21 09:53:13.080098 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jun 21 09:53:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:53:13.091198 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-5572b890-9520-4688-aac1-8a28cb27ac9f admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:53:13.098988 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-5572b890-9520-4688-aac1-8a28cb27ac9f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011351 Jun 21 09:53:13.099791 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jun 21 09:53:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:53:13.111079 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:53:13.119080 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011541 Jun 21 09:53:13.119580 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jun 21 09:53:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:53:13.130936 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b996375c-d7aa-4eb2-8bc1-dee6e42327b6 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:53:13.138499 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-b996375c-d7aa-4eb2-8bc1-dee6e42327b6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011678 Jun 21 09:53:13.139012 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jun 21 09:53:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:56:36.323148 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:36.324207 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 21 09:56:36.324603 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:56:36.466772 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_api:SELECT=6 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:56:36.580111 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-b2d6b34e-8b8e-4822-9fce-412a5dd6ec22 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:36.581262 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:56:36.581262 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: warnings.warn(msg) Jun 21 09:56:36.582436 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-b2d6b34e-8b8e-4822-9fce-412a5dd6ec22 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:36.582871 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-b2d6b34e-8b8e-4822-9fce-412a5dd6ec22 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:36.583670 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-b2d6b34e-8b8e-4822-9fce-412a5dd6ec22 admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:36.584704 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-b2d6b34e-8b8e-4822-9fce-412a5dd6ec22 admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:36.617581 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-b2d6b34e-8b8e-4822-9fce-412a5dd6ec22 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152274 Jun 21 09:56:36.618121 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 09:56:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:56:37.443026 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:37.444672 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Jun 21 09:56:37.445060 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:56:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:56:37.639754 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-daefef9e-ebec-4958-9eeb-006ba4884744 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:37.640982 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:56:37.640982 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: warnings.warn(msg) Jun 21 09:56:37.642236 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-daefef9e-ebec-4958-9eeb-006ba4884744 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:37.642669 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-daefef9e-ebec-4958-9eeb-006ba4884744 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:37.643465 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-daefef9e-ebec-4958-9eeb-006ba4884744 admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:37.643891 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-daefef9e-ebec-4958-9eeb-006ba4884744 admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:37.663059 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-daefef9e-ebec-4958-9eeb-006ba4884744 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075267 Jun 21 09:56:37.663580 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 09:56:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:56:48.884811 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:48.885845 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 21 09:56:48.886244 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:56:49.027087 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_cell0:SELECT=4 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:56:49.027838 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_cell1:SELECT=4 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:56:49.028530 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG dbcounter [-] [103007] Writing DB stats nova_api:SELECT=8 {{(pid=103007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:56:49.076300 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-3f9ed8af-20c0-47dd-99bc-a15718946120 admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:49.077467 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:56:49.077467 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: warnings.warn(msg) Jun 21 09:56:49.078666 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-3f9ed8af-20c0-47dd-99bc-a15718946120 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:49.079108 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-3f9ed8af-20c0-47dd-99bc-a15718946120 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:49.079886 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-3f9ed8af-20c0-47dd-99bc-a15718946120 admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:49.080344 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-3f9ed8af-20c0-47dd-99bc-a15718946120 admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:49.105301 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-3f9ed8af-20c0-47dd-99bc-a15718946120 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082597 Jun 21 09:56:49.105859 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 09:56:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:56:49.922479 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: DEBUG nova.api.openstack.wsgi [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] Calling method '>' {{(pid=103006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:49.923481 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: INFO nova.api.openstack.requestlog [None req-9a7ceec8-4ba9-4d51-84e6-44f32b6957b2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 21 09:56:49.923876 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: [pid: 103006|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 21 09:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:56:50.115812 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG nova.api.openstack.wsgi [None req-6b5fb1ff-8f98-49a8-9764-1561ea65ca8f admin admin] Calling method '>' {{(pid=103007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:56:50.117612 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:56:50.117612 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: warnings.warn(msg) Jun 21 09:56:50.118842 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-6b5fb1ff-8f98-49a8-9764-1561ea65ca8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:50.119280 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-6b5fb1ff-8f98-49a8-9764-1561ea65ca8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:50.120096 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-6b5fb1ff-8f98-49a8-9764-1561ea65ca8f admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:56:50.120530 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: DEBUG oslo_concurrency.lockutils [None req-6b5fb1ff-8f98-49a8-9764-1561ea65ca8f admin admin] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:56:50.145537 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: INFO nova.api.openstack.requestlog [None req-6b5fb1ff-8f98-49a8-9764-1561ea65ca8f admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081131 Jun 21 09:56:50.146321 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: [pid: 103007|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 21 09:56:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 09:57:46.777803 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: Tue Jun 21 09:57:46 2022 - graceful shutdown triggered... Jun 21 09:57:46.777911 dv-cinder-806605-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 09:57:46.778754 dv-cinder-806605-4-iscsi devstack@n-api.service[103006]: Gracefully killing worker 1 (pid: 103006)... Jun 21 09:57:46.779176 dv-cinder-806605-4-iscsi devstack@n-api.service[103007]: Gracefully killing worker 2 (pid: 103007)... Jun 21 09:57:47.779620 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: worker 1 buried after 1 seconds Jun 21 09:57:47.780180 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: worker 2 buried after 1 seconds Jun 21 09:57:47.780180 dv-cinder-806605-4-iscsi devstack@n-api.service[103005]: goodbye to uWSGI. Jun 21 09:57:47.781385 dv-cinder-806605-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 09:57:47.782236 dv-cinder-806605-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 09:57:47.785573 dv-cinder-806605-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 09:57:47.794153 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 09:57:47.796733 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 09:57:47 2022] *** Jun 21 09:57:47.796887 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 09:57:47.797019 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 09:57:47.797131 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: nodename: dv-cinder-806605-4-iscsi Jun 21 09:57:47.797239 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: machine: x86_64 Jun 21 09:57:47.797346 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: clock source: unix Jun 21 09:57:47.797462 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: pcre jit disabled Jun 21 09:57:47.797582 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: detected number of CPU cores: 4 Jun 21 09:57:47.797691 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: current working directory: / Jun 21 09:57:47.797807 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: detected binary path: /usr/bin/uwsgi-core Jun 21 09:57:47.797938 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: your processes number limit is 47680 Jun 21 09:57:47.797938 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: your memory page size is 4096 bytes Jun 21 09:57:47.797938 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: detected max file descriptor number: 2048 Jun 21 09:57:47.797938 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: lock engine: pthread robust mutexes Jun 21 09:57:47.798259 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: thunder lock: enabled Jun 21 09:57:47.798410 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 09:57:47.798410 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 09:57:47.842091 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: Python main interpreter initialized at 0x55c4bec739c0 Jun 21 09:57:47.842091 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: python threads support enabled Jun 21 09:57:47.842091 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: your server socket listen backlog is limited to 100 connections Jun 21 09:57:47.842091 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: your mercy for graceful operations on workers is 90 seconds Jun 21 09:57:47.842538 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 09:57:47.842538 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: *** Operational MODE: preforking *** Jun 21 09:57:47.848005 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: *** uWSGI is running in multiple interpreter mode *** Jun 21 09:57:47.848005 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: spawned uWSGI master process (pid: 117550) Jun 21 09:57:47.848005 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: spawned uWSGI worker 1 (pid: 117563, cores: 1) Jun 21 09:57:47.848005 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: spawned uWSGI worker 2 (pid: 117564, cores: 1) Jun 21 09:57:47.848005 dv-cinder-806605-4-iscsi devstack@n-api.service[117550]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 09:57:47.843025 dv-cinder-806605-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 09:57:48.516557 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 09:57:48.521004 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 09:57:49.713292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:57:49.713292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: from cryptography.utils import int_from_bytes Jun 21 09:57:49.713991 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:57:49.713991 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: from cryptography.utils import int_from_bytes Jun 21 09:57:49.716768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:57:49.716768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: from cryptography.utils import int_from_bytes Jun 21 09:57:49.717217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:57:49.717217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: from cryptography.utils import int_from_bytes Jun 21 09:57:52.120548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 09:57:52.121169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 09:57:52.121416 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 09:57:52.121715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 09:57:52.121979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 09:57:52.122372 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.122703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.123029 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.123352 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.123683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.124013 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.124342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.124663 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.124997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.125262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.125587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.125912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-4-iscsi {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.126239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.126548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.126862 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.127228 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.127490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.127812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.128146 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.128655 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.130008 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.130155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 09:57:52.130155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 09:57:52.130591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.130591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.130728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 09:57:52.130813 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.130892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 09:57:52.130975 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.131053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 09:57:52.131139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.131218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.131303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.131617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.131836 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.132096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.132333 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.132541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.132772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.133002 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.133218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-4-iscsi {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.133990 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.134223 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.134431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.134650 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.134866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.135073 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.135286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.135286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.135709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.135925 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.136143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.136364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-4-iscsi {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.136590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.136809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.137026 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.137205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.137384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.137384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.137708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.137871 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.138051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.138198 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.138352 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.138526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.138717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.138717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139291 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139771 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.139927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.140168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.140335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.141188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.141354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.141501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.141651 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.141802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.141802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142390 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142532 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.142994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.143148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.143292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.143436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.143436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.143738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-4-iscsi {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.143882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144044 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144661 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.144972 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.145125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.145268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.145425 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.145569 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.145718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.145860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146010 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146467 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146627 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146770 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.146911 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.147137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.147293 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.147444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.147587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.147729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.147877 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148068 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148512 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148667 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.148970 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.149796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.149951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.150094 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.150242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.150400 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.150563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.151444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.151615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.151767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.151911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.152127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.152282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.152434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.152578 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.152731 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.152880 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153034 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153186 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153483 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.153947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154092 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154241 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154385 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154835 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.154984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.155135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.155278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.155278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.155562 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.155717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.155859 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156057 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156207 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156785 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.156934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157083 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157383 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157699 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157842 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.157993 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.158149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.158302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.158446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.158639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.158798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.158949 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.159100 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.159244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.159394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.159547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.159703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.159856 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.160094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.160258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.160412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.160571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.160725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.161613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.161792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.161948 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.162102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.162255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.162410 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.162553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.162704 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.162858 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163017 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163161 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.163906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.164083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.164243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.164405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.164549 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.164735 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.164898 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165193 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165336 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165803 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.165954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.166105 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.166256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.166409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.166565 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.166715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.166865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167008 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167452 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167602 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167752 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.167904 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168070 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168214 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168527 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168527 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.168965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.169115 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.169268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.169422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.169566 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.169722 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.169876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.170034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.170195 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.170340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.170495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.170639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.170780 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.170929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.171380 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.171909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.172124 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.172280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.172426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.172569 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.172711 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.172872 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.173031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.173175 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.173325 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.173487 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.173645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.173788 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.173939 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.174083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.174235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.174379 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.174521 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.174696 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.174981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.175143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.175304 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.175449 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.175593 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.175745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.175889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.176084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.176234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.176378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.176534 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.176688 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.176843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.176993 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.177137 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.177137 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.177416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.177645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.177804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.177804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.178094 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.178237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.178389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.178539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.178690 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.178857 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.179008 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.179158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.179315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.179469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.179613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.179776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:57:52.179934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.180102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.180271 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.180441 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.180594 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.180746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.180901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.181044 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.181206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.181655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.182229 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.182229 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.182521 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.182680 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.182834 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.182999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.183151 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.183302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.183460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.183611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.183771 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.183915 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184837 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.184998 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.185223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.185379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.185534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.185686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.185830 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.185974 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186124 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186417 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.186868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.187140 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.187291 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.187452 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.187617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.187770 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.187921 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.188155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.188315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.188459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.188654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.188804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.188947 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.189096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.189250 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.189414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.189558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.189707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.189861 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190213 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190801 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.190958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.191109 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.191262 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.191645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.191822 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.192362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.192531 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.192677 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.192827 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.192978 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.193123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.193266 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.193428 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.193573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.193716 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.193867 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194608 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.194895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.195052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.195214 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.195435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.195592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.195744 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.196431 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.196431 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.196752 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.196904 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197056 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197207 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197351 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197507 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197651 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.197952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.198241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.198241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.198536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.198687 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.198831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.198992 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.199135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.199288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.199440 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.199592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.199744 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.199894 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.200109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.200264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.200503 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.200674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.200820 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.200964 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.201123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.201275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.201427 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.201790 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.201943 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.202474 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.202644 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.202792 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.202937 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203380 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.203922 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204210 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204350 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204763 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.204902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.205041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.205178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.205319 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.205469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.205673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.205806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.206944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207192 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207319 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207581 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207709 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.207969 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208243 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208382 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208510 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.208913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.209284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.209419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.209419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.209674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.209809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.209948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210468 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210468 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.210847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.211097 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.211225 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.211365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.211527 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.211527 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.212903 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213682 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.213913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214445 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214575 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214575 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.214979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215352 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215489 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215845 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.215997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.216320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.216453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.216591 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.216730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.216730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.216989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217761 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.217901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218607 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218607 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.218966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.219270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.219270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225220 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225498 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.225986 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226342 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.226999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227568 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227697 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227834 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.227997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228281 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228557 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.228955 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229083 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229211 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229338 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229466 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229602 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.229859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230110 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230110 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230372 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.230894 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231032 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.231551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.232281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.232409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.232409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.232671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.232814 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.232951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.233088 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.233218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.233603 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.233603 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.233867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.234150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.234150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.234421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.234552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235438 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.235840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236704 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.236843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237110 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237249 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237249 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237838 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.237972 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238100 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238637 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238637 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.238892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239029 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239159 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239688 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239688 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.239940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240239 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240632 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.240762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241428 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241428 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241696 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.241827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242214 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242214 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242477 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242616 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242908 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.242908 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243172 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243440 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243813 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.243951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.244367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.244500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.244500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.244777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245282 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.245953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.246236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.246435 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.246583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.246777 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.246921 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.247052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.247189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.247414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.247550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.247735 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.247884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.248081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.248324 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.248458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.248691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.248832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.249005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.249263 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.249397 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.249613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.249752 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.249943 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.250152 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.250287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.250554 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.250686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.250863 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.251176 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.251485 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.251659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.251802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.252119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.252258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.252452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.252596 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.252780 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.253031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.253173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.253372 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.253517 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.253683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.253964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.254127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.254409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.254548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.254691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.254872 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.255018 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.255510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.255646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.255785 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.255924 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.256113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.256113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.256378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.256591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.256758 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.256951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.257083 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.257211 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.257348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.257577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.257724 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.257931 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.258064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.258241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.259015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.259159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.259430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.259564 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.259751 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.259892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.260118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.260355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.260491 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.260738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.261059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.261200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.261371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.261599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.261741 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.261994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.262126 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.262312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.262509 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.262654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.262916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.263048 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.263768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.263913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.264113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.264248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.264537 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.264537 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.264867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.265696 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.265896 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266832 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.266988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.267190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.267324 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.267461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.267461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.267734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.267866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268407 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.268824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269479 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269609 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.269875 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.270018 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.270245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.270387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.270618 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.270758 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.270926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.271148 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.271290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.271539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.271674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.272020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.272161 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.272331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.272475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.272649 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.272938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.273082 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.273265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.273412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.273584 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.273836 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.273971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.274834 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.274989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.275132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.275270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.275494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.275989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.276128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.276280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.276420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.276420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.276674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.276820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.277042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.277209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.277486 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.277625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.277820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.277956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.278174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.278367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.278526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.278789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.278933 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.279123 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.279331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.279438 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.279748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.279850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.280188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.280286 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.280503 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.280684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.280831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.281119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.281223 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.281520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.281623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.281837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.282005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.282165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.282438 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.282540 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.282805 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.282899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.283113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.283332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.283434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.283734 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.283835 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.284088 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.284231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.284418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.284657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.284764 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.285065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.285169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.285337 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.285564 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.285701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.285979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.286090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.286297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.286432 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.286631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.286865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.287051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.287295 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.287395 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.287684 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.287793 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.288031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.288222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.288363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.288647 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.288741 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.288969 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.289125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.289284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.289553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.289674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.289916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.290052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.290244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.290478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.290578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.290855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.290947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.291171 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.291361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.291484 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.291781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.291874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.292112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.292292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.292457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.292740 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.292836 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.293063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.293205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.293381 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.293628 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.293728 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.294020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.294114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.294331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.294502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.294658 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.294938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295040 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295369 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.295963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.296275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.296378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.296587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.296779 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.296914 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.297218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.297312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.297571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.297664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.297888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.298092 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.298226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.298521 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.298766 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.298877 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.298963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.299186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.299408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.299509 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.299813 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.299913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.300149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.300301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.300465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.300728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.300832 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.301078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.301180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.301389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.301483 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.301707 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.301947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.302061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.302155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.302312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.302447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.302621 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.302745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.303016 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.303381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.303697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.303870 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.304059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.304285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.304437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.304636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.304799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.304958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.305101 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.305289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.305512 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.305676 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.305923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.306079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.306241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.306481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.306644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.306800 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.306943 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.307093 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.307236 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.307387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.307530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.307683 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.307833 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308163 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308271 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308367 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.308942 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309354 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309560 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309874 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.309977 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.310185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.310288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.310499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.310599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.310809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.310903 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.311120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.311212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.311433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.311532 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.311749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.311856 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.312095 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313210 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313576 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313670 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.313928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314472 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314607 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314707 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.314889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.315088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.315181 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.315398 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.315510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.315705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.315802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.316081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.316178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.316412 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.316505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.316784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.316915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.317068 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.317165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.317382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.317490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.317695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.317790 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.318082 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.318254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.318412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.318566 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.318717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.318857 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.319008 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.319157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.319311 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.319453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.319593 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.319906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.320078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.320231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.320231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.320525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.320673 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.320837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.321639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.321791 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.321944 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322241 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322677 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322830 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.322980 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.323129 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.323268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.323410 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.323563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.323703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.323841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324028 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324177 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324773 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.324919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.325056 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.325196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.325344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.325518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.325684 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.325854 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326483 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326810 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.326982 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.327088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.327310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.327412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.327636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.327737 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.327968 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.328165 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.328342 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.328477 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.328614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.328708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.328922 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.329024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.329248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.329341 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.329572 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.329824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.329915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330011 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330294 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330607 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.330935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.331155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.331249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.331524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.331758 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.331871 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.332056 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.332169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.332379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.332473 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.332711 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.332819 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333040 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333662 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333755 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.333966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334057 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334278 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334372 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334586 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.334986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.335197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.335290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.335501 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.335604 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.335846 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.335941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.336137 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.336244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.336453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.336596 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.337324 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.337421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.337642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.337745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.337953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.338054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.338287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.338408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.338600 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.338766 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.338908 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339210 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.339918 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.340162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.340264 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.340472 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.340580 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.340780 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.340873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.341095 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.341189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.341403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.341498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.341718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.341818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342027 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342120 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342343 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342653 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.342965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.343066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.343332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.343660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.343887 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344004 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344337 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344859 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.344959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.345202 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.345338 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.345512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.345629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.345829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.345983 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.346138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.346245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.346444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.346540 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.346749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.347017 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.347111 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.347364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.347495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.347670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.347760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348109 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348485 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.348924 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.349020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.349220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.349320 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.349565 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.349817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.349911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350499 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350851 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.350949 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.351116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.351210 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.351431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.351522 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.351742 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.351866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.352081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.352197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.352422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.352517 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.352737 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.352832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353360 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.353985 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.354083 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.354293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.354387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.354608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.354710 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.354923 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.355015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.355237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.355338 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.355561 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.355790 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.355896 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.356141 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.356239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.356461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.356555 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.356775 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.356874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.357083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.357185 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.357404 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.357546 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.357720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.357824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.358034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.358126 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.358846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359008 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359517 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359745 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.359838 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.360087 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.360350 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.360462 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.360694 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.360795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361334 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361648 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.361961 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.362061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.362314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.362413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.362630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.362730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.362940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.363033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.363257 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.363364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.363565 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.363802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.363906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364739 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364851 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.364951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.365120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.365216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.365428 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.365522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.365738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.365913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366044 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366357 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.366972 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.367066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.367291 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.367393 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.367598 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.367699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.367933 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.368051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.368272 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.368366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.368583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.368790 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.368918 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.369104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.369238 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.369434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.369551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.369774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.370080 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.370341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.370444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.370678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.370774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.370984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.371084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.371307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.371409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.371639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.371734 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.371948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.372062 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.372282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.372388 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.372598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.372700 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.372912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373013 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373221 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373648 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.373952 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.374169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.374276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.374481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.374572 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.374789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.374889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.375120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.375323 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.375417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.375672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.375767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376167 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376816 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.376963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.377109 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.377299 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.377448 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.377601 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.377760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.377915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.378068 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.378218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.378359 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.378499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.378657 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.378819 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.379035 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.379279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.379421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.379562 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.379718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.379860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380029 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380308 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.380907 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381337 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381485 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381638 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381785 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.381939 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382366 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.382953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.383094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.383243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.383912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.384101 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.384258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.384390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.384493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.384680 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.384783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385413 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385632 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.385936 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.386037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.386182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 09:57:52.386282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.386587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.386910 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.387216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.387519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.387840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.388181 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.388502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.388815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.389127 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.389475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.389791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.390345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.390681 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.391000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.391361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.391691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.392019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.392328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.392634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.392958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.393268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.393579 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.393889 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.394199 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.394509 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.394818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.395125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.395433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.395742 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.396071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.396382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.396691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.396999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.397312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.397656 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.397977 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.398296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.398608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.398926 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.399888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.400224 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.400536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.400848 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.401164 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.401493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.401806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.402110 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.402613 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.402928 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.403248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.403570 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.403881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.404224 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.404548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.404860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.405182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.405493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.405823 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.406161 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.406492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.406817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.407123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.407430 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.407739 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.408070 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.408391 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.408698 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.409001 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.409306 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.409786 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.409930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.410212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.410515 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.410818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.411125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.411429 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.411734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.412059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.412365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.412669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.412971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.413277 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.413579 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.413883 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.414185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.414488 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.414829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.415157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.415488 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.415804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.416156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.416471 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.416795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.417105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.417426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.417750 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.418066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.418380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.418714 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.419024 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.419334 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.419644 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.419952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.420283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.420594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.420920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.421245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.421553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.421878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.422196 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.422515 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.422831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.423140 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.423466 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.423776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.424105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.424421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.424728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.425039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.425354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.425669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.425996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.426341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.426649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.426978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.427302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.427647 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.427966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.428355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.428709 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.429023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.429335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.429641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:57:52.429882 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 09:57:52.448143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Registered counter for database nova_api Jun 21 09:57:52.468620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.475047 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.492275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Registered counter for database nova_api Jun 21 09:57:52.513964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.520534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.532085 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.context [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12bd7c28-46c5-4e5d-900d-cb840c6e27b8(cell1) {{(pid=117564) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 09:57:52.536200 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:57:52.537826 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:57:52.538624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:57:52.540643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:57:52.542654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Registered counter for database nova_cell0 Jun 21 09:57:52.546744 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Registered counter for database nova_cell1 Jun 21 09:57:52.554303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.557161 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.562271 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.577458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.context [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12bd7c28-46c5-4e5d-900d-cb840c6e27b8(cell1) {{(pid=117563) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 09:57:52.581593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:57:52.583216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:57:52.584047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:57:52.586010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:57:52.588086 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Registered counter for database nova_cell0 Jun 21 09:57:52.592149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Registered counter for database nova_cell1 Jun 21 09:57:52.599472 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.601554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.609518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.609857 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.704411 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.714342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Registered counter for database nova_cell0 Jun 21 09:57:52.723079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.727689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:52.760273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Registered counter for database nova_cell0 Jun 21 09:57:52.766981 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:57:52.771614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:57:53.050945 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:57:53.058831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:57:53.091389 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:57:53.099187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:57:53.402765 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:57:53.409320 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-61278864-296c-4912-aa93-1cf311ef4c41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:57:53.414651 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4bec739c0 pid: 117564 (default app) Jun 21 09:57:53.441119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 09:57:53.447094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-949bfa03-c475-4ff9-83de-0369420f57af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 09:57:53.452427 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4bec739c0 pid: 117563 (default app) Jun 21 09:58:47.058629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:47.059852 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:47.062024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:47.064197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:47.753159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1352262598", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "networks": [{"uuid": "47b7b65b-fa74-4571-89e1-c046d16e9f09"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:58:48.437461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] validate_networks() for [('47b7b65b-fa74-4571-89e1-c046d16e9f09', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 09:58:51.482507 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 09:58:51.483687 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 09:58:51.484640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 09:58:51.485062 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 09:58:51.485531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 09:58:51.531439 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:51.532172 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:51.533180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:51.533802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:51.614234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Getting quotas for project 04010e51729946f19aae76a3af4a5976. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:58:51.639954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Getting quotas for user 8c1def94f6364acd9da7f7e0654bc8fc and project 04010e51729946f19aae76a3af4a5976. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:58:51.689410 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 09:58:51.703850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 09:58:51.899030 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-03cde959-91e6-4bfd-be27-17ffb66bc714 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.851685 Jun 21 09:58:51.904137 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 09:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 09:58:51.915054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:51.917418 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:51.918477 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:51.919243 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:52.654503 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-de4a257a-d1e4-4048-bbea-6d44259abb54 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:58:52.655414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-de4a257a-d1e4-4048-bbea-6d44259abb54 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:58:53.358051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04916d67-fd76-488f-aad5-0a1b4a59a272 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: .version_select at 0x7f185023e550>, body: {"keypair": {"name": "tempest-keypair-2030354336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKwJCvYft2rJajzDl1lhZ1MGDyZPGb7SLd7qnaln/VEproMatBjTxoW3f1Txd9FHMLy89bwbLvMT/2mWoIdHwiB+pnNQ2LctOdPkqmounBl8QpZkc5fhgbMFrDqQ+foqA=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:58:53.414070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-04916d67-fd76-488f-aad5-0a1b4a59a272 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:58:53.419430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-04916d67-fd76-488f-aad5-0a1b4a59a272 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for user 1fde108762d645bc9c5c5791dfe646a0 and project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:58:53.516720 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-04916d67-fd76-488f-aad5-0a1b4a59a272 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.697283 Jun 21 09:58:53.517347 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 09:58:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 09:58:53.924833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-de4a257a-d1e4-4048-bbea-6d44259abb54 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:58:53.963137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-de4a257a-d1e4-4048-bbea-6d44259abb54 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1215 microversion: 2.1 time: 2.052096 Jun 21 09:58:53.966248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 1/3] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:58:51 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1215 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:58:54.054179 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-21123946", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:58:54.211323 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] validate_networks() for [('998abe51-10aa-4f82-8a14-81e4ec449f6c', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 09:58:54.988543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:58:54.991153 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:58:55.006574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:55.019311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:55.022910 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:55.025990 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:55.778554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:58:55.797608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a25b4893-db40-47c6-a1f9-4395eeddc64a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1219 microversion: 2.1 time: 0.821277 Jun 21 09:58:55.804085 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:58:54 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1219 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:58:56.613025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 09:58:56.614059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 09:58:56.614817 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 09:58:56.615636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 09:58:56.616344 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 09:58:56.642732 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:56.643190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:56.644011 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:56.644463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:56.705426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for project 7a80df511c544924a5708de2513bbc42. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:58:56.721163 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for user 7e98533664dd4bf6b90e471fc42ba41f and project 7a80df511c544924a5708de2513bbc42. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:58:56.762404 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 09:58:56.765712 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 09:58:56.824194 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:58:56.826256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:58:56.834597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:56.835260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:56.836758 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:56.837907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:56.866853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-470f72c9-a729-4aae-823c-41f26156aaee tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.023135 Jun 21 09:58:56.873842 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 3/5] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 09:58:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 09:58:56.880531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-100adcc0-e673-42fb-a976-0bb9338ab0f7 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:58:56.881445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-100adcc0-e673-42fb-a976-0bb9338ab0f7 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:58:57.063845 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:58:57.079182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0ce9449f-8a7d-46c9-af17-ebbfa7b483f8 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1211 microversion: 2.1 time: 0.262578 Jun 21 09:58:57.088239 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:58:56 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1211 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:58:57.475832 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-100adcc0-e673-42fb-a976-0bb9338ab0f7 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:58:57.514075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-100adcc0-e673-42fb-a976-0bb9338ab0f7 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1220 microversion: 2.1 time: 0.637391 Jun 21 09:58:57.525470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:58:56 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1220 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:58:57.895087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-612950194", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:58:58.064361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] validate_networks() for [('998abe51-10aa-4f82-8a14-81e4ec449f6c', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 09:58:58.365959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-99899e9c-3619-4295-8102-66c053d6a770 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: .version_select at 0x7f18501fe790>, body: {"keypair": {"name": "tempest-keypair-155728800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/DPrLrxMtZq96boFHsTZe1bVa9/wDot03vr9DhrIomFjkTj6zTB2l3Gk3Qhmg791TLhV7s8aeLdgMbHvgqMzFkwCNXiW5zCJkRtSgj++6PiaYMwWigwFcLg1/lFjx/Fw=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:58:58.428594 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-99899e9c-3619-4295-8102-66c053d6a770 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:58:58.453781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-99899e9c-3619-4295-8102-66c053d6a770 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:58:58.582412 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-99899e9c-3619-4295-8102-66c053d6a770 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.647773 Jun 21 09:58:58.586903 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 5/8] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 09:58:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:58:58.614997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:58:58.616174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:58:58.634795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:58.637042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:58.638023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:58:58.640454 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:58:59.521073 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:58:59.551734 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2465ea98-4ccf-43dd-bd02-fc6e230790e4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1273 microversion: 2.1 time: 0.959418 Jun 21 09:58:59.553171 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 6/9] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:58:58 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1273 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:58:59.763382 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1630645182", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e515ef0a-1336-465c-b3d6-451df27d3301"}], "security_groups": [{"name": "tempest-securitygroup--732254487"}], "key_name": "tempest-keypair-2030354336", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:00.582312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 09:59:00.583188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 09:59:00.583816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 09:59:00.584330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 09:59:00.584796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 09:59:00.659037 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:00.660333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:00.668191 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:00.668736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:00.829346 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for project 7a80df511c544924a5708de2513bbc42. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:59:00.861193 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for user 7e98533664dd4bf6b90e471fc42ba41f and project 7a80df511c544924a5708de2513bbc42. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:59:00.876810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] validate_networks() for [('e515ef0a-1336-465c-b3d6-451df27d3301', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 09:59:00.911298 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 09:59:00.932581 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 09:59:01.151515 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ec0074e6-fdf7-43d2-b543-66a604148169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.269637 Jun 21 09:59:01.154993 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 4/10] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 09:58:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 09:59:01.169416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:01.171902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:01.202537 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:01.207945 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:01.209017 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:01.215435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:01.451607 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:01.464284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8a4d3a46-02ca-45c5-b19d-f6e6822041bf tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1273 microversion: 2.1 time: 0.307550 Jun 21 09:59:01.464872 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:01 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:01.479031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-23def896-7c14-4b53-8474-663ae247d799 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:01.479601 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-23def896-7c14-4b53-8474-663ae247d799 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:01.607383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23def896-7c14-4b53-8474-663ae247d799 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:01.621814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-23def896-7c14-4b53-8474-663ae247d799 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1221 microversion: 2.1 time: 0.153949 Jun 21 09:59:01.626881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:01 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:02.361219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-48aa43e2-cdea-4012-9313-226d9a5bddaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'create', calling method: .version_select at 0x7f1850129940>, body: {"keypair": {"name": "tempest-keypair-878155602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJhMH4uUMmMMLHy1QSMloSrzWZELsw+X+uQTxPqh8W9kVmgRQ+riv1nHAVMS9sCFm4hwQM9HZF4M015tvHmINblr+joBElBUpgj4izD0HEQJkHNPmNO4X8IapEjz0GG0Q=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:02.397491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-48aa43e2-cdea-4012-9313-226d9a5bddaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for project 318fe395ab574501973a3a20d0c77bfc. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:59:02.403225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-48aa43e2-cdea-4012-9313-226d9a5bddaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for user bf85b80a4bb747da9bd07454536380c0 and project 318fe395ab574501973a3a20d0c77bfc. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:59:02.491075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-48aa43e2-cdea-4012-9313-226d9a5bddaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.334324 Jun 21 09:59:02.498150 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 7/13] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jun 21 09:59:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 342 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 21 09:59:02.503754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:02.508458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:02.522370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:02.528937 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:02.530123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:02.530958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:03.217261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 09:59:03.217779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 09:59:03.218348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 09:59:03.218804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 09:59:03.219548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 09:59:03.247479 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:03.251059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:03.252251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:03.253048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:03.283755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:59:03.289062 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for user 1fde108762d645bc9c5c5791dfe646a0 and project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:59:03.308882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 09:59:03.312726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 09:59:03.447124 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3574eaef-56bb-4c01-9249-61e7bddaf951 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.688399 Jun 21 09:59:03.457864 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 7/14] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 09:58:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 3698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 09:59:03.489538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:03.490192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:03.537031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:03.537491 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:03.538279 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:03.538755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:03.845912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:03.854706 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e6c32ee0-d7f9-4080-9e43-9e929a821dcc tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 1.354801 Jun 21 09:59:03.863631 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:02 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:03.878660 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4313b7de-1da5-4832-9f9f-7603b5576ea5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:03.903885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4313b7de-1da5-4832-9f9f-7603b5576ea5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:04.000425 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:04.014158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1bde403a-87e3-4622-8f70-9f64d2889561 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1217 microversion: 2.1 time: 0.550788 Jun 21 09:59:04.026557 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:03 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1217 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:04.206061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4313b7de-1da5-4832-9f9f-7603b5576ea5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:04.219423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4313b7de-1da5-4832-9f9f-7603b5576ea5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1238 microversion: 2.1 time: 0.348588 Jun 21 09:59:04.254286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:03 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1238 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:04.881005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:04.882939 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:04.903141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:04.903631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:04.904455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:04.904897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:05.035425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:05.036722 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:05.052100 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:05.052916 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:05.053860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:05.054448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:05.295888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:05.319311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-052a6dc0-b84d-4469-8699-a917cd129505 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1279 microversion: 2.1 time: 0.288777 Jun 21 09:59:05.320340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 10/18] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:05 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:05.351705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:05.357833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:05.391366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:05.401186 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:05.402279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:05.404593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:05.641495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:05.665514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-152fa8b0-5653-4317-b555-e665be956fe0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1290 microversion: 2.1 time: 0.335150 Jun 21 09:59:05.671705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 11/19] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:05 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1290 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:05.689766 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-871928523", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c994f52e-02e2-4742-8c3a-a41ee59b94bd"}], "security_groups": [{"name": "tempest-securitygroup--1975851186"}], "key_name": "tempest-keypair-155728800", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:06.114989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] validate_networks() for [('c994f52e-02e2-4742-8c3a-a41ee59b94bd', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 09:59:06.667325 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:06.681452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dd77d89f-9439-447d-b66a-9a4406b20791 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 1.801993 Jun 21 09:59:06.683620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 9/20] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:04 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:06.698512 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:06.700031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:06.717549 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:06.719183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:06.722431 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:06.723232 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:07.252000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:07.266330 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8e8d754a-eb99-4951-9476-6fc3173e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1279 microversion: 2.1 time: 0.580894 Jun 21 09:59:07.266780 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 10/21] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:06 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1279 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:07.293363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:07.296032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:07.309847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:07.311566 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:07.312482 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:07.312966 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:07.885564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:07.898719 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5ef32c9b-b56f-4c7c-ac7a-2f9e619d67d3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1290 microversion: 2.1 time: 0.630877 Jun 21 09:59:07.908368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:07 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1290 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:07.913419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:07.914645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:07.932838 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:07.933463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:07.934419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:07.935009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:08.072080 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 09:59:08.072775 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 09:59:08.073398 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 09:59:08.073816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 09:59:08.074231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 09:59:08.089134 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:08.089703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:08.090566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:08.091052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:08.159613 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:59:08.165523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:59:08.187616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 09:59:08.194703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 09:59:08.319747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9e4bcc68-50d8-4bbd-9a6e-7ed7b0c09990 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.646470 Jun 21 09:59:08.322540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 12/23] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 09:59:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 09:59:08.338840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:08.342021 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:08.350398 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:08.350899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:08.352218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:08.353415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:08.393465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:08.410397 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-53c8a520-68cb-4c9f-a417-55ac5e54f5a4 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.500585 Jun 21 09:59:08.412359 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:07 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:08.432598 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ac1914f4-b2c1-4078-a48f-d4c7ab49bb61 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:08.437701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ac1914f4-b2c1-4078-a48f-d4c7ab49bb61 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:08.610934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:08.624512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-caf08e27-e2c0-4be8-8ff1-6b0323f689a5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1279 microversion: 2.1 time: 0.298134 Jun 21 09:59:08.626208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:08 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:08.798009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ac1914f4-b2c1-4078-a48f-d4c7ab49bb61 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:08.811712 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ac1914f4-b2c1-4078-a48f-d4c7ab49bb61 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1240 microversion: 2.1 time: 0.395313 Jun 21 09:59:08.812336 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:08 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1240 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:08.929414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:08.930154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:08.940075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:08.942849 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:08.945892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:08.947423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:09.159374 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:09.214611 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-567a27c3-a8a3-4367-99d6-c2214579d74b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1290 microversion: 2.1 time: 0.286963 Jun 21 09:59:09.219932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:08 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1290 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:09.428627 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:09.429266 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:09.437184 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:09.437512 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:09.438320 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:09.438754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:09.544130 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-588257442", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e57ecdad-5631-4120-8112-a6e1a027f20d"}], "security_groups": [{"name": "tempest-securitygroup--458186652"}], "key_name": "tempest-keypair-878155602", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:10.203372 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:10.214326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6ed853b7-8f83-4ce3-b637-883c53eb7696 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.789479 Jun 21 09:59:10.216964 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 14/28] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:09 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:10.221776 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:10.229343 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:10.242938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:10.243666 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:10.257125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:10.257965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:10.429679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] validate_networks() for [('e57ecdad-5631-4120-8112-a6e1a027f20d', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 09:59:10.636859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:10.647203 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e2e093fc-9b08-4fc6-8634-3daea7324072 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1279 microversion: 2.1 time: 0.428973 Jun 21 09:59:10.648608 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 15/29] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:10 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1279 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:10.678641 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:10.681419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:10.685608 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:10.707487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:10.709316 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:10.711241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:10.714065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:11.020728 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:11.032302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-78f0dd3d-5830-4473-a733-4f6cd5687c3d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1292 microversion: 2.1 time: 0.369589 Jun 21 09:59:11.033042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 16/30] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:10 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1292 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:11.364358 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-a8480610-dafd-4190-95e6-b05f512909ce req-9bbf3679-34ea-47c1-a250-5f51a5cef985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4", "tag": "502190c8-39e6-4dd2-88db-bd888d75ac6b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:11.396826 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a8480610-dafd-4190-95e6-b05f512909ce req-9bbf3679-34ea-47c1-a250-5f51a5cef985 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:11.397295 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a8480610-dafd-4190-95e6-b05f512909ce req-9bbf3679-34ea-47c1-a250-5f51a5cef985 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:11.469560 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-a8480610-dafd-4190-95e6-b05f512909ce req-9bbf3679-34ea-47c1-a250-5f51a5cef985 service nova] Creating event network-changed:502190c8-39e6-4dd2-88db-bd888d75ac6b for instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 on hv-cinder-80660 Jun 21 09:59:11.470395 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a8480610-dafd-4190-95e6-b05f512909ce req-9bbf3679-34ea-47c1-a250-5f51a5cef985 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 09:59:11.471774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:11.472767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:11.473821 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:11.474530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:11.489995 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.compute.rpcapi [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 09:59:11.491283 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] Releasing lock "compute-rpcapi-router" {{(pid=117564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 09:59:11.528749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ab0638b5-db1b-4b10-a811-93a7e8cebf5a None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.494328 Jun 21 09:59:11.530015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 17/31] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:11.539388 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:11.540668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:11.576442 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:11.577265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:11.578152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:11.578717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:12.137243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:12.163627 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9344b6f6-121c-403e-be9f-856de05a7dd2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.631992 Jun 21 09:59:12.164297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:11 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:12.180215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:12.185150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:12.201246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:12.208460 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:12.209587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:12.224281 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:12.609581 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 09:59:12.610345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 09:59:12.610734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 09:59:12.611144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 09:59:12.611925 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 09:59:12.627554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:12.628020 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:12.630805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:12.632957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:12.669862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for project 318fe395ab574501973a3a20d0c77bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 09:59:12.675285 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for user bf85b80a4bb747da9bd07454536380c0 and project 318fe395ab574501973a3a20d0c77bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 09:59:12.701626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 09:59:12.702442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 09:59:12.792176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f4bf95e9-2364-4379-96a5-372b19eb856a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.251036 Jun 21 09:59:12.793327 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 15/33] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jun 21 09:59:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 21 09:59:12.798848 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:12.803940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:12.818331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:12.819075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:12.820089 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:12.822178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:13.093573 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.105979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3d00a554-9745-4496-a616-4524482322a1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.311373 Jun 21 09:59:13.106700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:12 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:13.112658 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:13.114961 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:13.121457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:13.121948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:13.122841 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:13.123554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:13.206234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.216439 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-45137a2a-4203-4e90-919d-7e75a38fadda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.107486 Jun 21 09:59:13.228601 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:13 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:13.241518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b4a86bcf-6dff-438a-8885-1f9c9e7e0fd2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:13.242729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b4a86bcf-6dff-438a-8885-1f9c9e7e0fd2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:13.251890 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:13.313600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b4a86bcf-6dff-438a-8885-1f9c9e7e0fd2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.327237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b4a86bcf-6dff-438a-8885-1f9c9e7e0fd2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.330309 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b4a86bcf-6dff-438a-8885-1f9c9e7e0fd2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.332557 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b4a86bcf-6dff-438a-8885-1f9c9e7e0fd2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1280 microversion: 2.20 time: 0.102350 Jun 21 09:59:13.333546 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 18/36] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:13 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1280 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:13.363675 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:13.364703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:13.389810 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:13.391050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:13.399958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:13.402575 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:13.481636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.495738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-000d9e61-4d04-4a40-ac81-9d616c434f3a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 1.328620 Jun 21 09:59:13.498298 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 19/37] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:12 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:13.581953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:13.594815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7ebc746a-c348-4ac4-8a60-90c65abaf083 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.258977 Jun 21 09:59:13.600305 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 19/38] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:13 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:13.883909 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-acebb45f-de67-48f6-84c4-80f867f94b79 req-08455253-9388-40a9-82c1-e1d3cf829139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f81dd1c-df4e-45e0-963a-9384e494395e", "tag": "b0d9edc0-6f2a-4930-aba3-8a357b12ebca"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:13.904072 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-acebb45f-de67-48f6-84c4-80f867f94b79 req-08455253-9388-40a9-82c1-e1d3cf829139 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:13.904723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-acebb45f-de67-48f6-84c4-80f867f94b79 req-08455253-9388-40a9-82c1-e1d3cf829139 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:13.932881 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-acebb45f-de67-48f6-84c4-80f867f94b79 req-08455253-9388-40a9-82c1-e1d3cf829139 service nova] Creating event network-changed:b0d9edc0-6f2a-4930-aba3-8a357b12ebca for instance 5f81dd1c-df4e-45e0-963a-9384e494395e on hv-cinder-80660 Jun 21 09:59:13.945987 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-acebb45f-de67-48f6-84c4-80f867f94b79 req-08455253-9388-40a9-82c1-e1d3cf829139 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066096 Jun 21 09:59:13.949945 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 20/39] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:14.123692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:14.124498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:14.131846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.137509 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.138469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.139138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.236939 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:14.237640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:14.249435 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.249884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.250830 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.251266 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.347276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.354324 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.365357 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-005c0218-afac-42b9-b01d-9ca6a05b0ce5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.246514 Jun 21 09:59:14.380274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0bf320a0-ca1e-4b8b-8c7b-80b3c1862326 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.136058 Jun 21 09:59:14.380382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 20/40] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:14 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:14.380481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 21/41] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:14 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:14.380986 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:14.381605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:14.388884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.389343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.390110 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.390544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.463195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.474962 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.476490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.477650 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fc64d511-2b30-4161-a687-e921e59325f6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1284 microversion: 2.20 time: 0.106668 Jun 21 09:59:14.478202 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:14 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:14.515158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:14.515949 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:14.524260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.524907 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.525840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.526280 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.615586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:14.617633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:14.625947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.626667 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.628596 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:14.629259 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:14.695828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.701218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:14.707014 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f6552820-e311-4902-b661-56d662b01d68 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.098364 Jun 21 09:59:14.710367 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3e18b7fd-67f9-4da6-b958-f497a82f3b75 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.200135 Jun 21 09:59:14.717381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 22/43] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:14 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:14.718095 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 22/44] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:14 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:15.390927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:15.393759 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:15.394366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:15.395820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:15.409705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.410171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.410956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.411394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.414981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.415670 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.416673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.417114 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.577012 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:15.605554 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-514488a6-ae19-4d77-aeac-eb84d46c102f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.219353 Jun 21 09:59:15.610065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 23/45] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:15 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:15.628396 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:15.629112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:15.643338 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.644983 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.646018 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.647943 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.686488 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:15.697394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bf781263-bcaf-4f56-bfda-f4a147d568a4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.312995 Jun 21 09:59:15.698035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 23/46] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:15 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:15.707005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:15.729609 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:15.730583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:15.744291 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.756215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.757203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.757674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.779260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:15.856619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:15.864423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:15.876010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0a794338-4a61-4a18-9505-a091bdb0ff52 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.150363 Jun 21 09:59:15.876466 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:15.886157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 24/47] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:15 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:15.886157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:15.886960 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:15.888088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:15.893196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2dc6650f-c993-41f3-a843-00ea889c9590 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1284 microversion: 2.20 time: 0.281113 Jun 21 09:59:15.893795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 24/48] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:15 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:15.909492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.911634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.913933 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.915205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:15.972535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-6c4075de-87df-44b0-9ed8-157cd31960a8 req-54d66669-a7d1-4c85-8234-f191cce69e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67cf0f01-c1f9-42da-8031-85ef8583d52c", "tag": "88a92e2c-8d38-4158-ac2b-cacf09d1e690"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:15.984638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6c4075de-87df-44b0-9ed8-157cd31960a8 req-54d66669-a7d1-4c85-8234-f191cce69e3a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:15.985503 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6c4075de-87df-44b0-9ed8-157cd31960a8 req-54d66669-a7d1-4c85-8234-f191cce69e3a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:16.009888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-6c4075de-87df-44b0-9ed8-157cd31960a8 req-54d66669-a7d1-4c85-8234-f191cce69e3a service nova] Creating event network-changed:88a92e2c-8d38-4158-ac2b-cacf09d1e690 for instance 67cf0f01-c1f9-42da-8031-85ef8583d52c on hv-cinder-80660 Jun 21 09:59:16.033708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-6c4075de-87df-44b0-9ed8-157cd31960a8 req-54d66669-a7d1-4c85-8234-f191cce69e3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049197 Jun 21 09:59:16.035237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 25/49] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 09:59:16.200490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:16.214898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5bdb8578-759e-4564-a8f3-cdcf0e926cb0 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.335636 Jun 21 09:59:16.214898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 25/50] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:15 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:16.631110 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:16.632275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:16.644686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:16.645245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:16.645953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:16.646381 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:16.719960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:16.722887 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:16.739894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:16.741307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:16.746684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:16.750143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:16.786363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:16.800626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d6b44fea-2156-4e50-87b3-58a045aa45c1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.174239 Jun 21 09:59:16.801215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 26/51] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:16 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:16.894913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:16.904226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:16.911000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:16.913755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:16.914775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:16.917840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:17.023178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:17.037865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-342a13d0-967b-42a5-8969-0960ff2a468a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.326959 Jun 21 09:59:17.039182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 26/52] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:16 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:17.045998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:17.046958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:17.067490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:17.068630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:17.069451 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:17.069927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:17.070055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:17.101104 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-320ee1ef-f0b3-49d0-9abc-04a3a91aefdc tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.210220 Jun 21 09:59:17.112291 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 27/53] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:16 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:17.181648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:17.192089 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:17.194182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:17.196638 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-23a98caf-7f9d-4451-b03b-3e7cfa86a2d8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1284 microversion: 2.20 time: 0.154343 Jun 21 09:59:17.198124 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 27/54] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:17 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:17.237948 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:17.239597 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:17.248470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:17.249131 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:17.249955 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:17.250589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:17.441887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:17.460206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6f771c92-4974-4f52-9688-9a0db5792240 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.229351 Jun 21 09:59:17.461451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 28/55] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:17 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:17.820867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:17.822106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:17.832390 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:17.833234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:17.834695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:17.835381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.049676 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.057014 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:18.057690 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:18.060018 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5da8439f-d79f-4b59-9bc7-866a833faf34 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.244519 Jun 21 09:59:18.060842 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 28/56] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:17 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:18.066660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.067113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.067880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.068339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.125057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:18.125975 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:18.134729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.135502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.137109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.137971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.358529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.370311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d505d69d-e909-43ea-9f24-fee1718cdef1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.251150 Jun 21 09:59:18.371176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 29/57] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:18 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:18.391643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:18.393725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:18.414572 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.415069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.415858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.416329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.626912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.646888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d378291d-a01f-4437-b8aa-7faed8fb8700 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.591089 Jun 21 09:59:18.648501 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.657135 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 29/58] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:18 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:18.664007 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.666407 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.666534 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:18.667626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:18.668035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ad54629a-b6b2-4a94-8e31-eec51f49ced6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1284 microversion: 2.20 time: 0.286593 Jun 21 09:59:18.677124 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.677884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.678931 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:18.679589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:18.693175 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 30/59] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:18 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:18.802426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=30 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:18.975928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:18.991164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-48717e5b-7981-4439-831e-ef842cd5cda1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.332383 Jun 21 09:59:18.991734 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 30/60] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:18 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:19.078543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:19.079877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:19.086338 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.086786 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.088419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.088863 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.166397 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:19.173953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b5a4daed-0aee-4171-bc71-9c3097d793f0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.100078 Jun 21 09:59:19.184914 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 31/61] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:19 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:19.390548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:19.391257 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:19.397887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.398541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.399285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.400457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.675430 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:19.680085 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:19.692886 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.694055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.698010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.700072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.847196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:19.863849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ca16a3d5-f028-4588-b230-571476a3116f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1296 microversion: 2.1 time: 0.475474 Jun 21 09:59:19.865222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 31/62] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:19 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1296 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:19.918779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:19.921434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:19.947531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.948246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:19.949192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:19.955340 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:20.140704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:20.157322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:20.161651 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:20.163014 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-861e9630-0b02-4c7d-9d9e-1cd733fd9444 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1332 microversion: 2.20 time: 0.296535 Jun 21 09:59:20.164166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 32/63] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:19 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1332 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:20.170468 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:20.171373 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:20.182733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:20.183702 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:20.184754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:20.185936 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:20.295557 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:20.304978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6f022e5a-76e4-4e89-96ba-0a3511385301 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.634029 Jun 21 09:59:20.316586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 32/64] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:19 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:20.322658 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:20.323538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:20.329845 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:20.335102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:20.336145 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:20.336662 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:20.429628 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:20.438886 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-edd9c075-d6f4-4ca0-b0dc-84a42cf344f4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1298 microversion: 2.1 time: 0.120869 Jun 21 09:59:20.439454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 33/65] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:20 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:20.633845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:20.650348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f829092b-90eb-41c4-bad1-eee940303b67 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.484630 Jun 21 09:59:20.651172 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 33/66] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:20 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:20.882920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:20.883797 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:20.893822 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:20.894567 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:20.895819 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:20.897015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.169332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:21.181483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:21.182104 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:21.185473 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-37e4f174-29f2-4007-ba6f-45f50e1dc029 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.305681 Jun 21 09:59:21.188107 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 34/67] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:20 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:21.188520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.199476 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.200531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.200990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.325027 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:21.334654 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:21.356398 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.358101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.363422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.365732 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.483842 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=8 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:21.672158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:21.686481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:21.690069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:21.697831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d84039d7-ab75-4c72-848d-9a6efb8542d9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1340 microversion: 2.20 time: 0.520241 Jun 21 09:59:21.701428 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:21 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1340 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:21.723204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:21.723900 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:21.757119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.757595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.760968 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.761425 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.926522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:21.935518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a78a5d11-cdc3-4e2b-899a-38b5dfe958e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.615990 Jun 21 09:59:21.940162 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 35/69] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:21 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:21.953732 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:21.954356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:21.965482 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.965941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:21.966730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:21.967171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:22.416619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:22.425348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2582f647-9460-4419-97db-f7ef458f1326 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.483852 Jun 21 09:59:22.426076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 36/70] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:21 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:22.432299 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:22.433851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:22.442533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:22.444641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:22.446550 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:22.448982 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:22.642809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:22.750165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:22.759252 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-54440b00-ec6c-4473-8f71-3959f5ce4aa5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 1.056398 Jun 21 09:59:22.759927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 35/71] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:21 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:22.766326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:22.767427 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:22.775502 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:22.776595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:22.778136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:22.779090 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:22.915253 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:22.926398 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7d11e3dc-8699-42de-b217-a8249f9fa291 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.498502 Jun 21 09:59:22.927233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 37/72] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:22 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:22.957156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:22.957674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:22.964524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:22.965219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:22.966215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:22.966838 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:23.010081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:23.025117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:23.027811 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:23.032066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-282a1256-57a9-4008-b58b-e05820d9256d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1338 microversion: 2.20 time: 0.270636 Jun 21 09:59:23.033079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 36/73] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:22 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1338 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:23.322710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=30 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:23.391303 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:23.422209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3f3465aa-5fab-40d0-8217-d10eada07fa5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.468792 Jun 21 09:59:23.422794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 38/74] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:22 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:23.448986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:23.450061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:23.466985 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:23.468207 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:23.471128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:23.471739 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:23.778268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:23.778885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:23.793971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:23.795046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:23.798504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:23.798979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.116516 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:24.134756 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-13191734-d468-431d-b061-8ceccb487cb1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.685477 Jun 21 09:59:24.135417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 37/75] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:23 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:24.136899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:24.150136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:24.153532 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:24.153683 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c166b334-471f-43f2-a4c8-e8274dce0166 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.381260 Jun 21 09:59:24.154165 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:23 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:24.168682 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.169150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.175101 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.176819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.725824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-83dc0a07-151e-45b6-a880-a7e6754c2ec1 req-b946ab02-3d0c-416e-838f-42238bd13986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4", "name": "network-vif-plugged", "status": "completed", "tag": "502190c8-39e6-4dd2-88db-bd888d75ac6b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:24.748018 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-83dc0a07-151e-45b6-a880-a7e6754c2ec1 req-b946ab02-3d0c-416e-838f-42238bd13986 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.749015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-83dc0a07-151e-45b6-a880-a7e6754c2ec1 req-b946ab02-3d0c-416e-838f-42238bd13986 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.752649 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:24.765211 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e9239b71-6449-4184-aca5-228f62728f15 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.619448 Jun 21 09:59:24.776520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-83dc0a07-151e-45b6-a880-a7e6754c2ec1 req-b946ab02-3d0c-416e-838f-42238bd13986 service nova] Creating event network-vif-plugged:502190c8-39e6-4dd2-88db-bd888d75ac6b for instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 on hv-cinder-80660 Jun 21 09:59:24.776520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-83dc0a07-151e-45b6-a880-a7e6754c2ec1 req-b946ab02-3d0c-416e-838f-42238bd13986 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 09:59:24.776520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.776520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.776520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.776918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.778838 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 38/77] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:24 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:24.784469 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:24.784878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.compute.rpcapi [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 09:59:24.785378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:24.786304 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 09:59:24.793547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.794004 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.794804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.795272 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.824488 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0f261987-bae8-4bd8-a677-59e0c19ee3a3 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.664870 Jun 21 09:59:24.825347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 40/78] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:24.836394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:24.838877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:24.849634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.850516 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.853497 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:24.854223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:24.875533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:25.226825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:25.244046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:25.245988 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:25.247298 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-29620333-4edc-4eb5-a329-b85e0bb40d65 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.467145 Jun 21 09:59:25.248410 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 39/79] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:24 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:25.263156 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-8dd2eb42-e211-4523-9312-2c98ba53a226 req-b9ce1745-48a7-40f4-949b-1b4a9e1f9240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe", "tag": "ee93fa93-b873-48d0-8002-d8977f4de733"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:25.282583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-8dd2eb42-e211-4523-9312-2c98ba53a226 req-b9ce1745-48a7-40f4-949b-1b4a9e1f9240 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.283065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-8dd2eb42-e211-4523-9312-2c98ba53a226 req-b9ce1745-48a7-40f4-949b-1b4a9e1f9240 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.301992 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-8dd2eb42-e211-4523-9312-2c98ba53a226 req-b9ce1745-48a7-40f4-949b-1b4a9e1f9240 service nova] Creating event network-changed:ee93fa93-b873-48d0-8002-d8977f4de733 for instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe on hv-cinder-80660 Jun 21 09:59:25.317822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-8dd2eb42-e211-4523-9312-2c98ba53a226 req-b9ce1745-48a7-40f4-949b-1b4a9e1f9240 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068019 Jun 21 09:59:25.318809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 40/80] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:25.338333 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:25.339079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:25.345820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.346274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.347053 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.347491 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.359725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:25.374468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9ce984a5-8935-4180-a563-0c59edbd866d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.541475 Jun 21 09:59:25.375064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 41/81] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:24 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:25.390975 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:25.396857 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:25.417588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.418374 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.419392 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.420032 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.595488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:25.607078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-05ec9689-4cd3-4f10-8ecf-796ca00b25be tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.282856 Jun 21 09:59:25.608821 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:25 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:25.785982 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:25.786868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:25.795274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.797400 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.798700 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:25.799490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:25.826056 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:26.098887 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:26.114126 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5a31e718-1565-4fb1-bc28-db173f341d0c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.738011 Jun 21 09:59:26.115934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 42/83] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:25 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:26.265944 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:26.266561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:26.279073 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:26.281602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:26.285994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:26.287599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:26.387284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:26.402498 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ad2035c7-f6b4-47a9-b706-b6bfc69a1eb5 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.622979 Jun 21 09:59:26.416175 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:25 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:26.423665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:26.426026 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:26.442662 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:26.443371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:26.445020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:26.445983 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:26.777061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:26.785274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:26.787070 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:26.788450 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d6d65757-cdf4-493d-aa63-eaa5e2a1b183 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.526853 Jun 21 09:59:26.789532 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 43/85] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:26 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 09:59:26.794235 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:26.795116 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:26.805999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:26.807739 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:26.809040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:26.811406 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.018456 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:27.030412 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-72d6280b-45b2-4d0f-9f70-737458e3d319 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.612657 Jun 21 09:59:27.031532 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:26 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:27.132420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:27.132669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:27.133177 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:27.142781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6247ce29-8de9-4b6a-8f02-2406b076782c tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.351943 Jun 21 09:59:27.145548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:26 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:27.154243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.154243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.154243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.154243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.347466 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-c2627c94-9e95-46a9-8c96-1bdc94982a52 req-baa88987-d5ba-4d4a-945d-00bf26021799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4f0fd3-df72-4ad2-bf46-da230bb50235", "tag": "aad0de81-1d91-47a9-b5f2-23512c106d78"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:27.370562 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c2627c94-9e95-46a9-8c96-1bdc94982a52 req-baa88987-d5ba-4d4a-945d-00bf26021799 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.371092 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c2627c94-9e95-46a9-8c96-1bdc94982a52 req-baa88987-d5ba-4d4a-945d-00bf26021799 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.399422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-c2627c94-9e95-46a9-8c96-1bdc94982a52 req-baa88987-d5ba-4d4a-945d-00bf26021799 service nova] Creating event network-changed:aad0de81-1d91-47a9-b5f2-23512c106d78 for instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 on hv-cinder-80660 Jun 21 09:59:27.410178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-c2627c94-9e95-46a9-8c96-1bdc94982a52 req-baa88987-d5ba-4d4a-945d-00bf26021799 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066544 Jun 21 09:59:27.411444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 45/88] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:27.426286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:27.430292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:27.443043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.446060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.447268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.450384 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.523106 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:27.533316 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-025d742c-5212-4b99-a546-a81075529571 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.402933 Jun 21 09:59:27.535362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 44/89] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:27 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:27.831527 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:27.841420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1c96698d-1b2b-4c81-848c-ae29fe3e5428 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.426535 Jun 21 09:59:27.841609 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-f051edfa-f49a-43f4-91b2-b56c93944bfa req-3c6a5f93-0fd0-456f-b571-1632105048e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:27.844597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 46/90] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:27 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:27.858486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-c1c0de7d-ba9f-4331-8c00-7c884de99dff req-2f4562b2-0adf-4997-b09f-538036c61d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf0f01-c1f9-42da-8031-85ef8583d52c", "name": "network-vif-plugged", "status": "completed", "tag": "88a92e2c-8d38-4158-ac2b-cacf09d1e690"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:27.862747 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f051edfa-f49a-43f4-91b2-b56c93944bfa req-3c6a5f93-0fd0-456f-b571-1632105048e1 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.866065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f051edfa-f49a-43f4-91b2-b56c93944bfa req-3c6a5f93-0fd0-456f-b571-1632105048e1 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.876652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c1c0de7d-ba9f-4331-8c00-7c884de99dff req-2f4562b2-0adf-4997-b09f-538036c61d80 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.877060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c1c0de7d-ba9f-4331-8c00-7c884de99dff req-2f4562b2-0adf-4997-b09f-538036c61d80 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.881550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-f051edfa-f49a-43f4-91b2-b56c93944bfa req-3c6a5f93-0fd0-456f-b571-1632105048e1 service nova] Creating event network-changed:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 09:59:27.889255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-f051edfa-f49a-43f4-91b2-b56c93944bfa req-3c6a5f93-0fd0-456f-b571-1632105048e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177267 Jun 21 09:59:27.892308 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 45/91] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:27.910142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-c1c0de7d-ba9f-4331-8c00-7c884de99dff req-2f4562b2-0adf-4997-b09f-538036c61d80 service nova] Creating event network-vif-plugged:88a92e2c-8d38-4158-ac2b-cacf09d1e690 for instance 67cf0f01-c1f9-42da-8031-85ef8583d52c on hv-cinder-80660 Jun 21 09:59:27.913325 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:27.914103 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:27.922434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-c1c0de7d-ba9f-4331-8c00-7c884de99dff req-2f4562b2-0adf-4997-b09f-538036c61d80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074547 Jun 21 09:59:27.925563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 47/92] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:27.937009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.937570 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:27.941993 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:27.942452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.049541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:28.050248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:28.057135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.057683 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.059127 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.059908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.196020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:28.208445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:28.211724 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:28.216456 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5cc2467e-0085-4a08-a475-1300753fb703 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.322316 Jun 21 09:59:28.228872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 46/93] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:27 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:28.234646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:28.235536 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:28.253115 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.254126 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.254979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.255467 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.323471 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:28.333511 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ae0eeb9d-0a91-4463-bf8a-a9b6d99e9841 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.288735 Jun 21 09:59:28.334822 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 48/94] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:28 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:28.488199 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:28.505814 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-23f9ec8c-aed8-4088-8cfa-30ba6bc6f7bd tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1315 microversion: 2.1 time: 0.274841 Jun 21 09:59:28.506718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 47/95] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:28 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:28.550425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:28.551339 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:28.558076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.558599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.559494 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.560112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.703539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:28.711171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9851c09f-8d3d-4fc5-8448-914d9aff8f79 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.164449 Jun 21 09:59:28.711798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 49/96] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:28 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:28.859845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:28.860796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:28.867884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.868923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:28.869814 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:28.870474 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.085643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:29.095250 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1e58428d-8a62-402a-9edd-4ab5015b519f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.240046 Jun 21 09:59:29.096659 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 48/97] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:28 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:29.237832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:29.240119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:29.254272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.255248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.256297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.257112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.353958 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:29.354669 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:29.361802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.362563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.363572 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.364147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.420803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:29.442178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:29.449192 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:29.455492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6393f228-2ca5-4999-bee4-e6ef7071b8d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.221721 Jun 21 09:59:29.458290 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 50/98] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:29 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:29.523158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:29.523808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:29.546670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.551042 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.552253 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.556511 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.563767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:29.572261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-26a0aa80-c3a4-4bb7-b3c3-7f56690579e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.223977 Jun 21 09:59:29.574912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 49/99] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:29 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:29.728746 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:29.729422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:29.738545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.739020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.739784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.740246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:29.867023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:29.879450 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1bdfacb7-ece9-481e-a782-50fab9d7582a tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1502 microversion: 2.1 time: 0.360502 Jun 21 09:59:29.880804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 51/100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:29 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1502 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:29.951256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-3e206300-5e52-4cfa-b219-e58fdffa75ab req-25bab8e4-0601-4b07-9657-96cefc05ef91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f81dd1c-df4e-45e0-963a-9384e494395e", "name": "network-vif-plugged", "status": "completed", "tag": "b0d9edc0-6f2a-4930-aba3-8a357b12ebca"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:29.982195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3e206300-5e52-4cfa-b219-e58fdffa75ab req-25bab8e4-0601-4b07-9657-96cefc05ef91 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:29.983169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3e206300-5e52-4cfa-b219-e58fdffa75ab req-25bab8e4-0601-4b07-9657-96cefc05ef91 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.025657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-3e206300-5e52-4cfa-b219-e58fdffa75ab req-25bab8e4-0601-4b07-9657-96cefc05ef91 service nova] Creating event network-vif-plugged:b0d9edc0-6f2a-4930-aba3-8a357b12ebca for instance 5f81dd1c-df4e-45e0-963a-9384e494395e on hv-cinder-80660 Jun 21 09:59:30.033731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-3e206300-5e52-4cfa-b219-e58fdffa75ab req-25bab8e4-0601-4b07-9657-96cefc05ef91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089003 Jun 21 09:59:30.035533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 52/101] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 09:59:30.043772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:30.051525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1aa02898-9cc5-434f-8c76-0327d7584e83 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.327595 Jun 21 09:59:30.066504 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 50/102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:29 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:30.114914 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:30.115654 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:30.134581 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:30.137908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.138732 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:30.139179 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.481681 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:30.482408 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:30.508099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:30.509635 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.511531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:30.512641 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.725444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:30.738059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0586ecfc-c504-4bca-936f-5e7a9182e373 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.628655 Jun 21 09:59:30.739588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 53/103] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:30 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:30.746761 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:30.747786 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:30.776494 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:30.777385 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.778377 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:30.778988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:30.996419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:31.004555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-30404f07-021d-4cc4-a727-a83d21cb2cc6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.263491 Jun 21 09:59:31.005755 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 54/104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:30 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:31.072207 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:31.073207 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:31.081230 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:31.081978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:31.082898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:31.083541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:31.273045 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:31.277633 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:31.286299 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:31.287808 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:31.288952 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5006a15b-bda7-44cf-b2b7-53e93468b55f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.815415 Jun 21 09:59:31.289497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 51/105] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:30 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:31.296623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e06e03ae-0174-482b-9dcf-ba20669e83b1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.222990 Jun 21 09:59:31.297244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 55/106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:31 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:31.763281 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:31.763934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:31.770474 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ef88d17-0a58-4131-a82a-be4dbf717f1f"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:31.772324 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:31.772481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:31.773664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:31.777045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:31.777501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:31.784770 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:31.787074 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:31.788587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:31.789231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.315750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:32.328751 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-031a7ac5-049a-43bd-a8f5-6293af45e071 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.577276 Jun 21 09:59:32.340117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 52/107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:31 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:32.347738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:32.348642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:32.356672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.357371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.359139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.361548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.424636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-615d217a-9792-481f-a26a-c7dd216f1e97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "POST /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657573 Jun 21 09:59:32.430063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 56/108] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 09:59:31 2022] POST /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:32.439876 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-9bdcf2f4-159e-4bd7-a1bf-95281ccf5b5a req-4e3fc21a-4de8-4c23-9873-4da42e29bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4f0fd3-df72-4ad2-bf46-da230bb50235", "name": "network-vif-plugged", "status": "completed", "tag": "aad0de81-1d91-47a9-b5f2-23512c106d78"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:32.451909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9bdcf2f4-159e-4bd7-a1bf-95281ccf5b5a req-4e3fc21a-4de8-4c23-9873-4da42e29bf67 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.452457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9bdcf2f4-159e-4bd7-a1bf-95281ccf5b5a req-4e3fc21a-4de8-4c23-9873-4da42e29bf67 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.464565 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-9bdcf2f4-159e-4bd7-a1bf-95281ccf5b5a req-4e3fc21a-4de8-4c23-9873-4da42e29bf67 service nova] Creating event network-vif-plugged:aad0de81-1d91-47a9-b5f2-23512c106d78 for instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 on hv-cinder-80660 Jun 21 09:59:32.469760 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-9bdcf2f4-159e-4bd7-a1bf-95281ccf5b5a req-4e3fc21a-4de8-4c23-9873-4da42e29bf67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037419 Jun 21 09:59:32.470875 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 57/109] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:32.483391 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:32.483391 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:32.483783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.484280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.485526 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.486201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.567875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:32.576072 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4b03cc3b-1f62-45aa-b65b-dc76d45fb9bf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.233307 Jun 21 09:59:32.576642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 53/110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:32 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:32.582148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:32.582760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:32.589138 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.589647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.590557 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:32.590996 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:32.640235 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:32.649772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:32.651265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:32.652416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6834c37c-7fd7-4118-a58c-6bb37cd22e23 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.180194 Jun 21 09:59:32.652978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 58/111] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:32 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:32.741164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:32.749377 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-93757206-2157-451a-8656-660892f58c06 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.170985 Jun 21 09:59:32.750066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 54/112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:32 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:33.349112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:33.349879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:33.357746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.358196 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.358964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.359394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.378987 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:33.561452 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:33.572738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f0480bbb-955d-464e-bdd9-982b5c64cb6a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.227941 Jun 21 09:59:33.574777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 59/113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:33 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:33.593309 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:33.594759 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:33.600935 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.601409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.602472 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.602644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.678535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:33.679423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:33.690144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.690600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.692460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.693252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.768393 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:33.777976 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3a52c043-67cc-4213-b0d4-7cfe0bf826e3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1321 microversion: 2.1 time: 0.188488 Jun 21 09:59:33.787781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 55/114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:33 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:33.787781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:33.787781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:33.811312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.812373 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:33.814173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:33.815254 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:34.103383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:34.112655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:34.114247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:34.115462 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fda1ebea-d897-4f85-b8c7-6c5fdbf7242a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.449554 Jun 21 09:59:34.116116 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 60/115] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:33 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:34.253765 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:34.261543 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-340cf32e-ace8-4dda-ab56-d379965dbc16 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.479052 Jun 21 09:59:34.262100 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 56/116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:33 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:34.488008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-0719f2bf-0eff-429f-99f2-5d73acaa6403 req-77774568-7244-400b-a6a0-96599bb9330e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe", "name": "network-vif-plugged", "status": "completed", "tag": "ee93fa93-b873-48d0-8002-d8977f4de733"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:34.497307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-0719f2bf-0eff-429f-99f2-5d73acaa6403 req-77774568-7244-400b-a6a0-96599bb9330e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:34.497754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-0719f2bf-0eff-429f-99f2-5d73acaa6403 req-77774568-7244-400b-a6a0-96599bb9330e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:34.510089 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-0719f2bf-0eff-429f-99f2-5d73acaa6403 req-77774568-7244-400b-a6a0-96599bb9330e service nova] Creating event network-vif-plugged:ee93fa93-b873-48d0-8002-d8977f4de733 for instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe on hv-cinder-80660 Jun 21 09:59:34.516831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-0719f2bf-0eff-429f-99f2-5d73acaa6403 req-77774568-7244-400b-a6a0-96599bb9330e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033688 Jun 21 09:59:34.517480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 61/117] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:34.590953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:34.591437 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:34.597970 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:34.598589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:34.599168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:34.600926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:34.776582 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:34.787774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5d05f485-985a-42a7-a9b2-defab2b96976 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.200843 Jun 21 09:59:34.793567 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:34.800895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 57/118] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:34 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:34.806735 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:34.807750 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:34.828204 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:34.830798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:34.831721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:34.832204 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:34.993000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:35.001009 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-edeff223-2cce-4944-9974-d3c22c7c5775 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1515 microversion: 2.1 time: 0.209451 Jun 21 09:59:35.001505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 62/119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:34 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:35.018585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:35.019601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:35.026219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.026684 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.027432 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.027862 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.090489 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lazy-loading 'flavor' on Instance uuid 67cf0f01-c1f9-42da-8031-85ef8583d52c {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 09:59:35.147095 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:35.147699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:35.154858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.155490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.156453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.157071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.173045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:35.237035 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-963364e0-54a2-4be1-b987-063eaabf6257 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c/action" status: 200 len: 32 microversion: 2.1 time: 0.221493 Jun 21 09:59:35.237717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 58/120] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 09:59:35 2022] POST /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 09:59:35.248609 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:35.249301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:35.256875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.257277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.258336 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.259494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.324640 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:35.338471 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:35.340549 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:35.341909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6317efdb-61e4-4928-9f51-a4e88e7e33e4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.211791 Jun 21 09:59:35.342964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 63/121] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:35 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:35.350692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:35.353664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:35.363347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.364149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.365029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.365688 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.460971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:35.471866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ba4671b3-527a-41a9-9054-3270072d5957 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.227518 Jun 21 09:59:35.482608 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 59/122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:35 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:35.534395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:35.544270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d6d59695-1187-4b8f-9782-cb4d044183e0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.199604 Jun 21 09:59:35.544999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 64/123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:35 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:35.807350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:35.808135 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:35.814986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.815539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:35.816813 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:35.817323 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.001015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:36.008385 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c3e15ed-462e-4583-a0e5-0f019b49be2e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.205415 Jun 21 09:59:36.008951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 60/124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:35 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:36.360412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:36.361279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:36.367999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.368479 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.369237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.369665 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.489643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:36.490477 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:36.497019 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.497472 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.498351 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.498783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.506474 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:36.514907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:36.516439 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:36.517543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d93bafea-dbfc-4e23-a8ab-d372bf34c69b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.161530 Jun 21 09:59:36.518090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 65/125] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:36 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:36.534862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-f15ae715-c433-4b65-b75b-89f4ec481508 req-2ff50973-de08-4fe5-b0ce-d68fa3c47eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "name": "network-vif-plugged", "status": "completed", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:36.542934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f15ae715-c433-4b65-b75b-89f4ec481508 req-2ff50973-de08-4fe5-b0ce-d68fa3c47eeb service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.543370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f15ae715-c433-4b65-b75b-89f4ec481508 req-2ff50973-de08-4fe5-b0ce-d68fa3c47eeb service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.554171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-f15ae715-c433-4b65-b75b-89f4ec481508 req-2ff50973-de08-4fe5-b0ce-d68fa3c47eeb service nova] Creating event network-vif-plugged:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 09:59:36.560692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-f15ae715-c433-4b65-b75b-89f4ec481508 req-2ff50973-de08-4fe5-b0ce-d68fa3c47eeb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029033 Jun 21 09:59:36.562350 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 66/126] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 09:59:36.567437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:36.568228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:36.574957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.575348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.576156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:36.576590 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:36.634517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:36.642193 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7c640c0e-9ee1-4d54-95af-337d2daf0c24 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.157174 Jun 21 09:59:36.645573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 61/127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:36 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:36.714092 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:36.721560 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1edde94d-e5b3-4183-a1e4-2ca7281a5ce9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.158110 Jun 21 09:59:36.722112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 67/128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:36 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:37.025237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:37.025884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:37.032194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.032640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.033646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.034100 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.181561 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:37.189132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c6c523d-f41c-4b79-adce-b0eddeae4f94 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.167726 Jun 21 09:59:37.189699 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 62/129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:37 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:37.536194 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:37.536862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:37.541025 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:37.545104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.545561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.546331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.546768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.659045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:37.659644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:37.666541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.667185 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.668145 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.668610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.696927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:37.706067 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:37.707942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:37.709388 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7936b124-7441-4ef9-ab5c-b18eb01839d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.177660 Jun 21 09:59:37.710152 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 68/130] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:37 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:37.739468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:37.740112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:37.746146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.746598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.747376 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:37.748003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:37.825454 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:37.834842 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c575c908-918c-44a5-8c65-756f7c09b95c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.180099 Jun 21 09:59:37.835812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 63/131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:37 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:37.956293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:37.965226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-77953924-2ef7-47be-b0fb-fe104e063f9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1366 microversion: 2.1 time: 0.230714 Jun 21 09:59:37.965845 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 69/132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:37 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:38.208142 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:38.208807 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:38.215763 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.216284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.217242 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.217823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.388923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:38.403646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-19db69a0-1a7e-494c-b00e-11e0a433f907 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1363 microversion: 2.1 time: 0.199255 Jun 21 09:59:38.404246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 64/133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:38 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:38.729254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:38.730503 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:38.739083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.739525 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.740378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.740977 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.853183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:38.853789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:38.860609 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.861052 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.861984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.862570 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.895599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:38.906112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:38.908185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:38.909703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-15e10f8a-4380-424a-b85f-f9410a68a542 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.185633 Jun 21 09:59:38.911178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 70/134] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:38 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:38.981469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:38.982324 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:38.993349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.994231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:38.996687 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:38.997348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.148505 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:39.157477 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-89ab3761-7b1d-4180-a828-6873c259c0cf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.308321 Jun 21 09:59:39.158431 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 65/135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:38 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:39.236971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:39.247214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-706dee51-f778-4d09-92ac-1331454a63af tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1555 microversion: 2.1 time: 0.269785 Jun 21 09:59:39.248113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 71/136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:38 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:39.265689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:39.266240 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:39.269539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:39.273906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.274394 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.275355 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.275794 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.387848 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-70029f5d-ace7-4f4c-a001-3f84e3db6f1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126080 Jun 21 09:59:39.388856 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 66/137] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 09:59:39 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:39.420686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:39.421646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:39.428512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.429165 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.430223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.431441 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.804942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:39.826136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6c41942b-e240-49d9-903b-05996b38db60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1548 microversion: 2.1 time: 0.409316 Jun 21 09:59:39.828501 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 72/138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:39 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1548 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:39.848850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:39.850021 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:39.858755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.859197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.860566 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.861351 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.930797 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:39.931888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:39.943692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.944436 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:39.945811 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:39.946462 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:40.038419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-babfb2e0-fb39-4b9a-92d2-9cd914cd764b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196275 Jun 21 09:59:40.039194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 67/139] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 09:59:39 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:40.176288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:40.177300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:40.187609 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:40.188839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:40.189961 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:40.190625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:40.193363 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:40.204227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:40.205711 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:40.207102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-59dd598c-a35e-4e88-9966-60aaf1082bd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.282114 Jun 21 09:59:40.209180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 73/140] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:39 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 09:59:40.785943 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:40.800229 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-23de1c60-c5d1-4588-b125-070df0fdd72d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.629007 Jun 21 09:59:40.801318 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 68/141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:40 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:41.230071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:41.233126 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:41.243431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:41.244326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:41.245668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:41.246348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:41.480172 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:41.503856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:41.505634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:41.507406 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0e2e88d9-1c19-41a7-9693-b82ceaf8f570 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1405 microversion: 2.20 time: 0.285425 Jun 21 09:59:41.508077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 74/142] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:41 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:41.819497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:41.821493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:41.830828 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:41.831668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:41.832797 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:41.833457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:42.266869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:42.275234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1ade06e4-623c-4a03-aa6c-6f477e59ea35 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.459703 Jun 21 09:59:42.276360 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 69/143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:41 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:42.526598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:42.527177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:42.537083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:42.537525 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:42.538292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:42.541769 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:42.693264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-4d2f93c3-bb03-4c66-96cc-c05339ccce0f req-642bca6b-d5c6-46a2-bf1c-bf8eb690a3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4f0fd3-df72-4ad2-bf46-da230bb50235", "tag": "aad0de81-1d91-47a9-b5f2-23512c106d78"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:42.715382 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4d2f93c3-bb03-4c66-96cc-c05339ccce0f req-642bca6b-d5c6-46a2-bf1c-bf8eb690a3da service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:42.715829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4d2f93c3-bb03-4c66-96cc-c05339ccce0f req-642bca6b-d5c6-46a2-bf1c-bf8eb690a3da service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:42.746492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-4d2f93c3-bb03-4c66-96cc-c05339ccce0f req-642bca6b-d5c6-46a2-bf1c-bf8eb690a3da service nova] Creating event network-changed:aad0de81-1d91-47a9-b5f2-23512c106d78 for instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 on hv-cinder-80660 Jun 21 09:59:42.755835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-4d2f93c3-bb03-4c66-96cc-c05339ccce0f req-642bca6b-d5c6-46a2-bf1c-bf8eb690a3da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064153 Jun 21 09:59:42.757531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 70/144] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:42.769864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:42.780599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:42.782266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:42.785433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-789884db-607c-4520-a764-441e95c5e1b6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1596 microversion: 2.20 time: 0.262499 Jun 21 09:59:42.787203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 75/145] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 09:59:42 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1596 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 09:59:42.808924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:42.810835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:42.829166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:42.829775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:42.832770 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:42.833292 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:43.214068 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-18dc642f-6735-4a28-8603-af34121cf0d1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.410252 Jun 21 09:59:43.214911 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 71/146] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jun 21 09:59:42 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-interface => generated 284 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 09:59:43.294663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:43.295923 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:43.310700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:43.313835 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:43.314852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:43.317898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:43.937183 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:43.947751 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e990a131-9d17-4436-afa6-a000663e2c20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.659293 Jun 21 09:59:43.948360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 76/147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:43 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:44.776995 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-71dcd424-0aed-43ba-90e1-394a65c97aea req-d797f7aa-9e25-49a1-b5f1-e281caff43e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe", "tag": "ee93fa93-b873-48d0-8002-d8977f4de733"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:44.785215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-71dcd424-0aed-43ba-90e1-394a65c97aea req-d797f7aa-9e25-49a1-b5f1-e281caff43e2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:44.786869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-71dcd424-0aed-43ba-90e1-394a65c97aea req-d797f7aa-9e25-49a1-b5f1-e281caff43e2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:44.801825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-71dcd424-0aed-43ba-90e1-394a65c97aea req-d797f7aa-9e25-49a1-b5f1-e281caff43e2 service nova] Creating event network-changed:ee93fa93-b873-48d0-8002-d8977f4de733 for instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe on hv-cinder-80660 Jun 21 09:59:44.813632 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-71dcd424-0aed-43ba-90e1-394a65c97aea req-d797f7aa-9e25-49a1-b5f1-e281caff43e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040628 Jun 21 09:59:44.818663 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 72/148] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:44.967882 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:44.968600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:44.987321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:44.987774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:44.997580 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:44.998291 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:45.027839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:45.097827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-50a977a3-96cf-4523-9b2a-f51448d8fc9f req-1def8998-d19c-4310-b1a3-c20ebc6382a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:45.113468 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-50a977a3-96cf-4523-9b2a-f51448d8fc9f req-1def8998-d19c-4310-b1a3-c20ebc6382a4 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:45.114395 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-50a977a3-96cf-4523-9b2a-f51448d8fc9f req-1def8998-d19c-4310-b1a3-c20ebc6382a4 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:45.127465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-50a977a3-96cf-4523-9b2a-f51448d8fc9f req-1def8998-d19c-4310-b1a3-c20ebc6382a4 service nova] Creating event network-changed:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 09:59:45.137852 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-50a977a3-96cf-4523-9b2a-f51448d8fc9f req-1def8998-d19c-4310-b1a3-c20ebc6382a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044939 Jun 21 09:59:45.138971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 73/149] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 09:59:45.185768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:45.196384 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-03b92afe-f47f-4357-b8d2-b3c00b4d864c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.235508 Jun 21 09:59:45.197419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 77/150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:44 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:46.213445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:46.214171 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:46.220355 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:46.220799 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:46.221563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:46.222002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:46.395353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:46.404128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b2e5b14a-445f-442e-a5d9-5dd3de93ae6d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.194659 Jun 21 09:59:46.413635 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 74/151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:46 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:47.420913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:47.423301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:47.430276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:47.430728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:47.432229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:47.432620 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:47.658723 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:47.668135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dbfac54b-6ea2-479d-bac6-fb2792023226 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.250863 Jun 21 09:59:47.672022 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 78/152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:47 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:48.687135 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:48.687752 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:48.694542 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:48.694994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:48.695772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:48.696326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:48.777769 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:48.778265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:48.784738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:48.785183 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:48.785940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:48.786352 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:48.812897 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 09:59:48.858984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:48.872180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-38ed3637-816d-4fc3-8783-f4e26093892d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.188257 Jun 21 09:59:48.873098 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 75/153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:48 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:48.930700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-02fff00d-b599-45be-8c4c-55e0ff55ce97 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 204 len: 0 microversion: 2.1 time: 0.156061 Jun 21 09:59:48.935203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 79/154] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 09:59:48 2022] DELETE /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 09:59:48.940270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:48.940890 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:48.948210 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:48.948872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:48.949709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:48.950184 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:49.096042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:49.106743 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-98cf73f0-4e6d-4a00-ae6c-a7dbe86d1c18 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1554 microversion: 2.1 time: 0.170387 Jun 21 09:59:49.107337 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 76/155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:48 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:49.890283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:49.891118 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:49.910179 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:49.910713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:49.911997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:49.912508 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:50.066281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:50.074508 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-151abd1a-e578-4ef0-a398-ec6b486850a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.188877 Jun 21 09:59:50.075068 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 80/156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:49 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:50.124865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:50.125701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:50.133024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:50.133720 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:50.135239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:50.135800 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:50.157977 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:50.270268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:50.278378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c6564dc6-0147-440d-bde6-7111e28c3bc1 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1554 microversion: 2.1 time: 0.157426 Jun 21 09:59:50.278937 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 77/157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:50 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:51.090942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:51.091547 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:51.098126 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:51.098571 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:51.099323 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:51.099754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:51.231672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:51.242349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4c6cd728-74de-4c86-b321-da6c384c22a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.155641 Jun 21 09:59:51.242932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 81/158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:51 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:51.294455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:51.295165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:51.301394 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:51.301935 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:51.302770 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:51.303283 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:51.434935 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:51.442841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c9accce6-47f6-4576-8b25-17f7b7a121f9 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1554 microversion: 2.1 time: 0.152226 Jun 21 09:59:51.443398 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 78/159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:51 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:52.259875 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:52.260519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:52.266881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:52.267320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:52.268106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:52.268538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:52.467158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:52.469348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:52.480641 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:52.481629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:52.482777 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:52.483451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:52.537731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:52.546322 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4391ad5d-10b5-4130-a0c0-23ff94e96ad6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.290634 Jun 21 09:59:52.547002 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 82/160] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:52 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:52.551489 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-8c22a996-24f4-4ccb-8703-9b07ede5b687 req-621bfb63-8060-4846-b0ec-4348cf553db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4", "name": "network-vif-deleted", "tag": "502190c8-39e6-4dd2-88db-bd888d75ac6b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 09:59:52.566345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8c22a996-24f4-4ccb-8703-9b07ede5b687 req-621bfb63-8060-4846-b0ec-4348cf553db7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:52.568622 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8c22a996-24f4-4ccb-8703-9b07ede5b687 req-621bfb63-8060-4846-b0ec-4348cf553db7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:52.581526 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-8c22a996-24f4-4ccb-8703-9b07ede5b687 req-621bfb63-8060-4846-b0ec-4348cf553db7 service nova] Creating event network-vif-deleted:502190c8-39e6-4dd2-88db-bd888d75ac6b for instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 on hv-cinder-80660 Jun 21 09:59:52.583799 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:52.587944 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-8c22a996-24f4-4ccb-8703-9b07ede5b687 req-621bfb63-8060-4846-b0ec-4348cf553db7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039705 Jun 21 09:59:52.588883 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 83/161] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 09:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 09:59:52.593180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e3154625-698f-4b66-8f29-05ff04cc8d96 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1512 microversion: 2.1 time: 0.132354 Jun 21 09:59:52.593754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 79/162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:52 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1512 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:53.562974 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:53.564382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:53.571552 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:53.572293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:53.573124 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:53.573555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:53.610055 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:53.611032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:53.617370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:53.617907 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:53.618799 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:53.619308 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:53.651420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:53.651869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:53.652348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lazy-loading 'fault' on Instance uuid c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 09:59:53.713140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1def94f6364acd9da7f7e0654bc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04010e51729946f19aae76a3af4a5976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:53.721362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-713aa2d7-18dc-465b-815f-d2d0d7aa641e tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 200 len: 1351 microversion: 2.1 time: 0.115278 Jun 21 09:59:53.722457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 80/163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:53 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:53.728283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:53.736049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-88a79b0c-9866-46fb-8058-903a2f099cea tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.177220 Jun 21 09:59:53.736731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 84/164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:53 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 09:59:54.738619 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:54.739401 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:54.745309 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:54.746222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:54.746494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:54.747179 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:54.752720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:54.753467 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:54.759969 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:54.760447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:54.761222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:54.761574 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] HTTP exception thrown: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.761706 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Request method failure captured: Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 HTTP/1.1 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZW4-AolMd7vxXEfY0Goc2r9_koyfDMjuu2uDWknCiT66gph7Wh7o3fXfY16f0L2b2vNlfnLzQTuokV_M2dXEUPGKHiQMBcJoiLo-rS3AWqvJ4o8MuzBbzv_eZMLpg53Cs_b43jPyZNxFOSpfuhGREU7UI77udETdEWJEfOrAKrtA0 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 09:59:54.766475 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_04010e51729946f19aae76a3af4a5976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/04010e51729946f19aae76a3af4a5976"}]}] Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 8c1def94f6364acd9da7f7e0654bc8fc Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.767678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4'} Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:59:54.768390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.769487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.770452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Returning 404 to user: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:59:54.770452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c878928b-fcbc-4da0-9148-5705a7a04d1d tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 404 len: 111 microversion: 2.1 time: 0.033315 Jun 21 09:59:54.770452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 81/165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:54 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 09:59:54.895583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:54.896859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:54.904043 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:54.904497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:54.905275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:54.905784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:54.909092 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:54.916754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-51276a76-460c-4242-9bf9-b76c4e90bcc9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.168232 Jun 21 09:59:54.917633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 85/166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:54 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:54.924520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] HTTP exception thrown: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Request method failure captured: Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4/os-volume_attachments HTTP/1.1 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZW4-AolMd7vxXEfY0Goc2r9_koyfDMjuu2uDWknCiT66gph7Wh7o3fXfY16f0L2b2vNlfnLzQTuokV_M2dXEUPGKHiQMBcJoiLo-rS3AWqvJ4o8MuzBbzv_eZMLpg53Cs_b43jPyZNxFOSpfuhGREU7UI77udETdEWJEfOrAKrtA0 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 09:59:54.926708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_04010e51729946f19aae76a3af4a5976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/04010e51729946f19aae76a3af4a5976"}]}] Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 8c1def94f6364acd9da7f7e0654bc8fc Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.928247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'server_id': 'c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4'} Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:59:54.929069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:54.930363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:54.932216 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Returning 404 to user: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:59:54.932216 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3cce62f7-287c-4a52-8861-d7a347f52afb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038766 Jun 21 09:59:54.932625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 82/167] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 09:59:54 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 09:59:55.934675 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:55.935280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:55.942432 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:55.942877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:55.943632 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:55.944091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:56.073395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:56.080950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b18b83af-6fe1-4b5f-b7dd-595bc4bae25f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.150670 Jun 21 09:59:56.081504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 86/168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:55 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:56.126749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:56.127327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:56.133544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:56.133999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:56.134758 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:56.135194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:56.148263 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] HTTP exception thrown: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Request method failure captured: Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 HTTP/1.1 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZW4-AolMd7vxXEfY0Goc2r9_koyfDMjuu2uDWknCiT66gph7Wh7o3fXfY16f0L2b2vNlfnLzQTuokV_M2dXEUPGKHiQMBcJoiLo-rS3AWqvJ4o8MuzBbzv_eZMLpg53Cs_b43jPyZNxFOSpfuhGREU7UI77udETdEWJEfOrAKrtA0 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 09:59:56.149919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_04010e51729946f19aae76a3af4a5976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/04010e51729946f19aae76a3af4a5976"}]}] Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 8c1def94f6364acd9da7f7e0654bc8fc Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.151264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4'} Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:59:56.154762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.156093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.157370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Returning 404 to user: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:59:56.157370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-73d2c94f-ff87-43c9-805f-def6e6f3fe36 tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 404 len: 111 microversion: 2.1 time: 0.028700 Jun 21 09:59:56.157370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 83/169] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 09:59:56 2022] DELETE /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 09:59:56.159791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:56.160453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] [instance: c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:56.167017 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:56.167466 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:56.168262 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:56.168724 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:56.184422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] HTTP exception thrown: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Request method failure captured: Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 HTTP/1.1 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZW4-AolMd7vxXEfY0Goc2r9_koyfDMjuu2uDWknCiT66gph7Wh7o3fXfY16f0L2b2vNlfnLzQTuokV_M2dXEUPGKHiQMBcJoiLo-rS3AWqvJ4o8MuzBbzv_eZMLpg53Cs_b43jPyZNxFOSpfuhGREU7UI77udETdEWJEfOrAKrtA0 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 09:59:56.189273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_04010e51729946f19aae76a3af4a5976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04010e51729946f19aae76a3af4a5976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/04010e51729946f19aae76a3af4a5976"}]}] Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 04010e51729946f19aae76a3af4a5976 Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1506443978 Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 8c1def94f6364acd9da7f7e0654bc8fc Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-DeleteServersTestJSON-1506443978-project Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.190636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4'} Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 09:59:56.191420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. Jun 21 09:59:56.192733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 09:59:56.193855 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] Returning 404 to user: Instance c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 09:59:56.193855 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5ec0bcc8-5f15-4fb2-a4dd-e6497f38abbb tempest-DeleteServersTestJSON-1506443978 tempest-DeleteServersTestJSON-1506443978-project] 10.222.0.36 "GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4" status: 404 len: 111 microversion: 2.1 time: 0.034954 Jun 21 09:59:56.193855 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 87/170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:56 2022] GET /compute/v2.1/servers/c9a7f788-dc4c-42e9-8daa-42b70ed6dfb4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 09:59:57.098358 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:57.099388 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:57.106310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:57.106763 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:57.107622 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:57.108196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:57.249213 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:57.258146 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1333d412-8bba-4584-8507-aad009985067 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.163848 Jun 21 09:59:57.268513 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:57 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:58.274785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:58.275388 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:58.282666 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:58.283170 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:58.283892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:58.284364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:58.416751 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:58.424317 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cebe30d6-65d7-446a-b639-a199c5bb0674 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.153483 Jun 21 09:59:58.424868 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 88/172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:58 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 09:59:59.445297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 09:59:59.445907 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 09:59:59.452156 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:59.452665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:59.453616 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 09:59:59.454051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 09:59:59.667441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 09:59:59.675721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3ed32480-d0a4-4a9a-8dc0-a215c3605912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.234243 Jun 21 09:59:59.676639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 85/173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 09:59:59 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:00.693069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:00.693705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:00.700617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:00.701057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:00.701841 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:00.702269 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:00.850809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:00.862573 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-da5ce3c5-e546-4feb-ac32-62b57920fe5d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.173233 Jun 21 10:00:00.863144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:00 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:01.880155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:01.880879 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:01.887458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:01.888146 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:01.888928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:01.889364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:02.058001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:02.066576 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-85398fd2-f3d9-481c-9430-f881556061a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.190501 Jun 21 10:00:02.067138 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:01 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:02.186478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-18346de6-7c13-44c0-bdb3-66184a1b0fb5 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184af359d0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:02.233654 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-18346de6-7c13-44c0-bdb3-66184a1b0fb5 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/cb5b3151-6535-434b-b758-a480efb94005" status: 200 len: 351 microversion: 2.1 time: 0.050991 Jun 21 10:00:02.234215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:00:02 2022] GET /compute/v2.1/os-volumes/cb5b3151-6535-434b-b758-a480efb94005 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:03.083890 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:03.084542 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:03.091118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:03.091599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:03.092384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:03.092847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:03.227627 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:03.236399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ef241dcb-0edb-431d-9a37-53e939f92cff tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.156324 Jun 21 10:00:03.237100 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 87/177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:03 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:03.588694 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2577ef9f-cbd5-45a9-890e-91f8a6525b79 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae35b80>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:03.641542 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2577ef9f-cbd5-45a9-890e-91f8a6525b79 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93dbe43e-73c9-4994-8584-a33319ea12b4" status: 200 len: 349 microversion: 2.1 time: 0.058551 Jun 21 10:00:03.642147 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 91/178] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:00:03 2022] GET /compute/v2.1/os-volumes/93dbe43e-73c9-4994-8584-a33319ea12b4 => generated 349 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:00:04.254508 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:04.255175 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:04.261172 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:04.261616 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:04.263006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:04.263511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:04.401001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:04.409490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c408df73-4aa4-48c0-b95f-922abd3c87be tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.160614 Jun 21 10:00:04.410058 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 88/179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:04 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:05.039335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-afbb257a-0823-47d0-b296-a76501f577bd tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae3c5e0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.087661 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-afbb257a-0823-47d0-b296-a76501f577bd tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3b71ce10-fc15-4fc4-8db6-4b9d7029cc44" status: 200 len: 351 microversion: 2.1 time: 0.052359 Jun 21 10:00:05.088343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 92/180] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes/3b71ce10-fc15-4fc4-8db6-4b9d7029cc44 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:05.101039 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3fb7db59-a555-4b3e-b592-405754a7ac0b tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae97c10>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.205821 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3fb7db59-a555-4b3e-b592-405754a7ac0b tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.109212 Jun 21 10:00:05.206399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:05.219214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fb47d5e1-4a32-4f92-8371-9a08921b8cd0 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184af92280>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.298563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fb47d5e1-4a32-4f92-8371-9a08921b8cd0 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083313 Jun 21 10:00:05.299123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 93/182] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:05.310394 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-11bc5b63-2b70-4c9b-9bd4-e74b571aea39 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae07f70>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.389991 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-11bc5b63-2b70-4c9b-9bd4-e74b571aea39 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083184 Jun 21 10:00:05.390559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:05.402383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-237d44e2-0732-45a0-a755-4ccf3018b441 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184af35e50>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.426809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.430022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:05.436315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:05.436765 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:05.437528 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:05.437986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:05.503929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-237d44e2-0732-45a0-a755-4ccf3018b441 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.105797 Jun 21 10:00:05.504537 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 94/184] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:05.516528 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-039b648b-755a-4f2b-92b9-3274cb36d6e7 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae350d0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.577424 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:05.585206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-82c52fa8-a354-4420-8d4a-73b7ea08a927 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.162451 Jun 21 10:00:05.585850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:05.606479 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-039b648b-755a-4f2b-92b9-3274cb36d6e7 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094125 Jun 21 10:00:05.607083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:00:05.624079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c43796a6-92d5-4d85-9c91-4bb2d87f8a08 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae17790>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.705946 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c43796a6-92d5-4d85-9c91-4bb2d87f8a08 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089955 Jun 21 10:00:05.706521 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 92/187] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:05.718277 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f6060c5e-06e9-4ef4-bbf0-16eaab37b5e7 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae353a0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.814344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f6060c5e-06e9-4ef4-bbf0-16eaab37b5e7 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.099781 Jun 21 10:00:05.814906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 96/188] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:05.826669 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-61964449-29c7-40d5-b198-62920699b964 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] Calling method '.version_select at 0x7f184ae301f0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:05.912251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-61964449-29c7-40d5-b198-62920699b964 tempest-VolumesTestJSON-1735621439 tempest-VolumesTestJSON-1735621439-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089235 Jun 21 10:00:05.912754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 93/189] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jun 21 10:00:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:06.603872 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:06.604512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:06.610817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:06.611271 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:06.612072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:06.612514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:06.751421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:06.759464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-59092433-8d3e-4954-a5fc-33d13b0ab53e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.160421 Jun 21 10:00:06.759725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 97/190] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:06 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:07.775647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:07.776312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:07.782959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:07.783409 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:07.784217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:07.784656 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:07.918634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:07.926430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-43b48643-b7fb-4575-b1f0-0b275f40c801 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.155053 Jun 21 10:00:07.927119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 94/191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:07 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:08.942401 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:08.943008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:08.945484 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:08.950903 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:08.951349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:08.952144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:08.952578 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:09.090614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:09.098113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2cc89476-9ff2-4837-a167-8c7ecccaf6e9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1521 microversion: 2.1 time: 0.159536 Jun 21 10:00:09.098902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 98/192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:08 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:10.115364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:10.116001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:10.117934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=51 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:10.123101 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:10.123548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:10.124330 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:10.124764 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:10.255885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:10.263866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d8aa95c2-d01c-46d6-8c76-460a728584bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1501 microversion: 2.1 time: 0.152273 Jun 21 10:00:10.264458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 95/193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:10 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:10.280802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:10.281414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:10.289114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:10.289558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:10.291258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:10.291734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:10.423616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:10.431434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a04afa1a-13cb-46f3-980b-a236ed151c9e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1514 microversion: 2.1 time: 0.154934 Jun 21 10:00:10.432167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 99/194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:10 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:11.824967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:11.826055 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:11.832060 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:11.832517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:11.833279 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:11.833720 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:11.858868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lazy-loading 'flavor' on Instance uuid 5f81dd1c-df4e-45e0-963a-9384e494395e {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:00:11.931822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-32201e90-08e5-4f35-8293-ed56128851aa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/action" status: 200 len: 32 microversion: 2.1 time: 0.111293 Jun 21 10:00:11.932640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 96/195] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:00:11 2022] POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:00:11.941647 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:11.942537 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:11.950135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:11.950703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:11.951505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:11.952167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:12.381608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:12.386094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:12.392850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7f7c2466-e25c-43b1-98cd-a95ac015acb4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.455168 Jun 21 10:00:12.393615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 100/196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:11 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:13.411541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:13.412197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:13.418314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:13.418758 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:13.419507 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:13.419944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:13.545784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:13.549245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:13.554405 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-86eecb56-906a-4760-9c21-25287853a7b6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.147654 Jun 21 10:00:13.554952 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 97/197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:13 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:14.571539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:14.572212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:14.580801 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:14.581279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:14.582029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:14.582479 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:14.806178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:14.813636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c4b69b7b-fcc6-4636-a8f0-5e304737df54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.245871 Jun 21 10:00:14.814200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 101/198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:14 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:15.834290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:15.835623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:15.843306 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:15.844120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:15.844975 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:15.845538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:15.997874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:16.005403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6789d747-8e4d-46ac-9c51-c7712648ec4a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.177736 Jun 21 10:00:16.005964 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 98/199] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:15 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:17.022632 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:17.023981 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:17.032765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:17.033633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:17.034894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:17.035475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:17.254669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:17.263021 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1d8b713f-8d12-42a3-8110-ecdccba76323 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.244847 Jun 21 10:00:17.263870 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 102/200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:17 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:18.284167 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:18.284857 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:18.293375 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:18.294017 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:18.295032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:18.295600 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:18.444162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:18.452158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6237222e-0e6a-4a56-839d-493d033c866b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.175430 Jun 21 10:00:18.452716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 99/201] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:18 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:19.468789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:19.469378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:19.475779 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:19.476257 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:19.477011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:19.477443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:19.605191 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:19.612912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c9dcfe19-b7b2-49ec-807e-a84bdbb7a82b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.147934 Jun 21 10:00:19.613465 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 103/202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:19 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:20.629997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:20.630506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:20.637147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:20.637591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:20.638339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:20.638771 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:20.766060 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:20.773555 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ef0044d1-0214-45f5-8e9c-25f03641ef86 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.147500 Jun 21 10:00:20.774108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 100/203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:20 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:21.559678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-507646458", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "networks": [{"uuid": "185c9add-805f-4bad-835c-abfdebede942"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:21.610278 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] validate_networks() for [('185c9add-805f-4bad-835c-abfdebede942', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:00:21.790117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:21.790845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:21.799655 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:21.800580 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:21.801959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:21.802730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:21.940191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:21.949074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-04260925-d34b-4e3b-9ed0-bc5d059f8c37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.162477 Jun 21 10:00:21.949867 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 101/204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:21 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:21.957775 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:00:21.958196 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:00:21.958665 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:00:21.959068 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:00:21.959473 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:00:21.968759 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:21.969276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:21.970131 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:21.970633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:21.987634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Getting quotas for project 8918c8442bf64ad28ea153a36b194f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:21.991569 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Getting quotas for user dc1444d1ccf94601a11be7ed6f643798 and project 8918c8442bf64ad28ea153a36b194f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:22.003963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:00:22.006228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:00:22.053909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-274b9c2d-5351-497b-998b-834ab2b94f16 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498060 Jun 21 10:00:22.054755 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 104/205] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:00:22.064763 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8301937a-5f97-4f5f-bb50-4a8e0ce5f1fe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:22.065380 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8301937a-5f97-4f5f-bb50-4a8e0ce5f1fe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:22.129196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8301937a-5f97-4f5f-bb50-4a8e0ce5f1fe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:22.136699 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8301937a-5f97-4f5f-bb50-4a8e0ce5f1fe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1218 microversion: 2.1 time: 0.075655 Jun 21 10:00:22.137182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 102/206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:22 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:22.966754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:22.967332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:22.973988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:22.974486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:22.975239 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:22.975672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:23.099616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:23.107572 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-78806cdf-c3aa-441e-82e8-a34fbf736581 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.145336 Jun 21 10:00:23.108150 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 105/207] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:22 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:23.153058 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:23.153662 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:23.159530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:23.159997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:23.160745 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:23.161173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:23.221829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:23.230314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eaab36e6-efba-43ac-b33f-e7b8975bed22 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1270 microversion: 2.1 time: 0.080922 Jun 21 10:00:23.231221 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 103/208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:23 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:24.125159 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:24.125768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:24.132228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:24.132672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:24.133426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:24.133858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:24.248713 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:24.249329 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:24.255347 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:24.255795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:24.256589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:24.257019 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:24.267626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:24.275597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ce644bee-6677-45f8-8581-fd83441fc139 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.154294 Jun 21 10:00:24.276471 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 106/209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:24 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:24.316521 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:24.324848 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c2b0f63a-805f-4704-91ad-147ac54e82fa tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1270 microversion: 2.1 time: 0.080055 Jun 21 10:00:24.325395 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 104/210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:24 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:25.292901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:25.293497 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:25.299869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:25.300343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:25.301094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:25.301530 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:25.341595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:25.342361 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:25.348996 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:25.349451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:25.350225 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:25.350661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:25.415003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:25.422430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3c2509da-3d01-44c8-bd93-459f375bb79b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1270 microversion: 2.1 time: 0.085192 Jun 21 10:00:25.422994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 105/211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:25 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:25.428237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:25.435708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cce5a49e-8b39-4e30-8f9d-0d9a4f924209 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.146684 Jun 21 10:00:25.436287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 107/212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:25 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:26.438572 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:26.439181 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:26.445437 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:26.445896 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:26.446717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:26.447165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:26.453245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:26.455415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:26.465049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:26.465765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:26.467047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:26.468082 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:26.582704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:26.590924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-df7b80dc-5d78-4f37-a88f-33d1a3276981 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.156044 Jun 21 10:00:26.591573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 106/213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:26 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:26.696090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:26.704180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8fc8f02d-de06-4f68-9315-9ffbceb28d33 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.255422 Jun 21 10:00:26.704741 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 108/214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:26 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:27.613327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:27.614105 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:27.622516 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:27.623150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:27.623930 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:27.624429 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:27.722270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:27.722881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:27.730563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:27.731166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:27.731941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:27.732409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:27.754231 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:27.764321 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c20cbe4c-0f40-4eb4-9aec-9b05c3bc333d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.154912 Jun 21 10:00:27.765148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 107/215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:27 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:27.853520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-088c0205-467a-4bb6-9d95-db1f27bc7b0f req-6d26db07-f8fa-4999-b505-7ff4c5ca080f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8350f7-d196-4024-aff3-344819dfc6fb", "tag": "49ea6b43-9094-4864-b575-067d46d75c72"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:27.862150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-088c0205-467a-4bb6-9d95-db1f27bc7b0f req-6d26db07-f8fa-4999-b505-7ff4c5ca080f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:27.862581 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-088c0205-467a-4bb6-9d95-db1f27bc7b0f req-6d26db07-f8fa-4999-b505-7ff4c5ca080f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:27.885247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-088c0205-467a-4bb6-9d95-db1f27bc7b0f req-6d26db07-f8fa-4999-b505-7ff4c5ca080f service nova] Creating event network-changed:49ea6b43-9094-4864-b575-067d46d75c72 for instance ea8350f7-d196-4024-aff3-344819dfc6fb on hv-cinder-80660 Jun 21 10:00:27.891420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-088c0205-467a-4bb6-9d95-db1f27bc7b0f req-6d26db07-f8fa-4999-b505-7ff4c5ca080f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042883 Jun 21 10:00:27.892244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 108/216] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:27.930030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:27.937519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-da5c688a-28ca-498f-a2e1-54ea071b26fb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.219381 Jun 21 10:00:27.938071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 109/217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:27 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:28.782004 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:28.782729 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:28.789445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:28.790096 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:28.791175 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:28.791471 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:28.927874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:28.935865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7306521e-d5d6-4350-86df-4741e1262f03 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.158015 Jun 21 10:00:28.936513 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 109/218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:28 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:28.953973 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:28.954574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:28.960978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:28.961422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:28.962220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:28.962651 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:29.138206 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:29.150564 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-70b29ba1-7cd0-4949-b278-994739842009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.200024 Jun 21 10:00:29.151380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 110/219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:28 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:29.952128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:29.953467 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:29.960614 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:29.961131 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:29.961901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:29.962416 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.155465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:30.164499 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a810ab76-43b6-4f05-919d-a1e0f5a1a597 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.216224 Jun 21 10:00:30.172893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:30.174522 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 110/220] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:29 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:30.174990 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:30.181855 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.182307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.183214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.183654 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.376414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:30.387043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3009f1c2-31ad-4a66-b488-ed2ad25d4e37 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1500 microversion: 2.1 time: 0.222515 Jun 21 10:00:30.387934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 111/221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:30 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1500 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:30.403760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd6a338-0074-422e-bafc-f51ce219cd02"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:30.406458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:30.413293 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.413749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.414522 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.415001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.444919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] HTTP exception thrown: Cannot 'attach_volume' instance 5f81dd1c-df4e-45e0-963a-9384e494395e while it is in vm_state rescued Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Request method failure captured: Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/os-volume_attachments HTTP/1.1 Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 74 Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZdNDs9Ko7zlYJF7H_bJbHJTVIxnR8iGyhh1iKzgo9tfzm7Svxw-WB014SREFGIM7P_lLu6Ghf31048vHTUBRrYMMQy18C_ZxTbkgL6HgyCBvJyUJ0oOzic6vkfhxAjsVX79jz9W-PUH4Kfyf6NYfDz6HMYI4uevPVz6pwxH6_pbdY Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:00:30.447041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a80df511c544924a5708de2513bbc42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a80df511c544924a5708de2513bbc42"}]}] Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 7e98533664dd4bf6b90e471fc42ba41f Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {"volumeAttachment": {"volumeId": "bbd6a338-0074-422e-bafc-f51ce219cd02"}} Jun 21 10:00:30.448553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Cannot 'attach_volume' instance 5f81dd1c-df4e-45e0-963a-9384e494395e while it is in vm_state rescued Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'server_id': '5f81dd1c-df4e-45e0-963a-9384e494395e', 'body': {'volumeAttachment': {'volumeId': 'bbd6a338-0074-422e-bafc-f51ce219cd02'}}} Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:00:30.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5f81dd1c-df4e-45e0-963a-9384e494395e while it is in vm_state rescued Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:00:30.450924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5f81dd1c-df4e-45e0-963a-9384e494395e while it is in vm_state rescued Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Returning 409 to user: Cannot 'attach_volume' instance 5f81dd1c-df4e-45e0-963a-9384e494395e while it is in vm_state rescued {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cef4ac21-745c-4ac6-9273-c8e8dcbcd724 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048826 Jun 21 10:00:30.452215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 111/222] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:00:30 2022] POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 10:00:30.458552 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:30.459096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:30.465156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.466013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.467008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.467653 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.545601 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-504a9e35-570c-46d6-a4a1-22742f012ac2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/action" status: 202 len: 0 microversion: 2.1 time: 0.090799 Jun 21 10:00:30.548015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 112/223] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:00:30 2022] POST /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:00:30.554619 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:30.555223 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:30.564119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.564569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.565549 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:30.566207 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:30.848325 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:30.865333 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-15a5d85b-eccb-48b2-bf40-1d70e1be3a1d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1508 microversion: 2.1 time: 0.314609 Jun 21 10:00:30.866423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 112/224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:30 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:31.182904 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:31.183919 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:31.190630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:31.191182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:31.192102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:31.192612 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:31.652454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:31.662635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-06c8d5a4-8cd9-4c9e-b069-b52e58843d15 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.484343 Jun 21 10:00:31.664102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 113/225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:31 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:31.883873 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:31.886358 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:31.895853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:31.896620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:31.898225 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:31.898982 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:32.134171 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:32.171823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:32.180267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7eca0e82-1277-4168-b323-20eabd36fa04 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1508 microversion: 2.1 time: 0.301079 Jun 21 10:00:32.181753 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 113/226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:31 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:32.690175 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:32.691168 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:32.699046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:32.700104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:32.702954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:32.703364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:32.704682 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:32.705892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:33.045438 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:33.055517 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-07b38127-b8ec-4eb9-bc7b-5a72a0c9126b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.378267 Jun 21 10:00:33.057437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 114/227] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:32 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:33.200412 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:33.201630 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:33.220051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:33.220507 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:33.221291 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:33.221726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:33.520827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:33.541589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-789c2cf5-48c4-485a-81e6-de5767cdac59 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1508 microversion: 2.1 time: 0.341016 Jun 21 10:00:33.542951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 114/228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:33 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:34.075138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:34.075878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:34.085220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:34.085942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:34.087651 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:34.088506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:34.363696 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:34.381979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4db538d9-efd2-4e4e-a1cb-45de342cd09b tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.311954 Jun 21 10:00:34.388256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 115/229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:34 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:34.561045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:34.562881 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:34.571962 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:34.572682 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:34.573662 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:34.574863 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:34.908290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:34.917386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2f7a4460-7f5a-404f-8a4e-6907e1db0ed3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1514 microversion: 2.1 time: 0.362157 Jun 21 10:00:34.918187 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 115/230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:34 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:35.406282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:35.407804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:35.418737 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:35.419483 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:35.420534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:35.421153 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:35.616016 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:35.625836 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-df571fe1-3970-4d5f-a981-945b1be17ac7 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.225365 Jun 21 10:00:35.637367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 116/231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:35 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:36.331906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2604ef2c-dd8c-4bf8-af00-e838599afc78 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'create', calling method: .version_select at 0x7f184ae5b8b0>, body: {"keypair": {"name": "tempest-keypair-148919559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQRfj6MN5Eyos6z/HS044CdoKIm4/ZnVFzSMrXXDEzgILCQAxxx/Yavyn5k0TkGJ65RFs4YhwbIqBSZtadMHscsKqIgKvW/vJ2tLTGsfMfXNXQbTKaRwPT7L37g0Zg2wQ=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:36.336626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-92a387e6-dc25-43b0-b538-e3b19bda5ead req-6a96db3d-ab07-45ae-849f-bc4eae5bb427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8350f7-d196-4024-aff3-344819dfc6fb", "name": "network-vif-plugged", "status": "completed", "tag": "49ea6b43-9094-4864-b575-067d46d75c72"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:36.345519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-92a387e6-dc25-43b0-b538-e3b19bda5ead req-6a96db3d-ab07-45ae-849f-bc4eae5bb427 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:36.346205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-92a387e6-dc25-43b0-b538-e3b19bda5ead req-6a96db3d-ab07-45ae-849f-bc4eae5bb427 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:36.350129 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-2604ef2c-dd8c-4bf8-af00-e838599afc78 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for project 7a80df511c544924a5708de2513bbc42. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:36.351406 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:36.359110 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-2604ef2c-dd8c-4bf8-af00-e838599afc78 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for user 7e98533664dd4bf6b90e471fc42ba41f and project 7a80df511c544924a5708de2513bbc42. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:36.360813 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-92a387e6-dc25-43b0-b538-e3b19bda5ead req-6a96db3d-ab07-45ae-849f-bc4eae5bb427 service nova] Creating event network-vif-plugged:49ea6b43-9094-4864-b575-067d46d75c72 for instance ea8350f7-d196-4024-aff3-344819dfc6fb on hv-cinder-80660 Jun 21 10:00:36.367230 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-92a387e6-dc25-43b0-b538-e3b19bda5ead req-6a96db3d-ab07-45ae-849f-bc4eae5bb427 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Jun 21 10:00:36.368031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 117/232] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:00:36.390342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2604ef2c-dd8c-4bf8-af00-e838599afc78 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062670 Jun 21 10:00:36.391230 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 116/233] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:00:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:36.643954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:36.644670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:36.651219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:36.651536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:36.652342 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:36.652949 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:36.931327 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:36.943300 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eb3e276d-b5c5-4654-bedd-5261cc1c16e0 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.304249 Jun 21 10:00:36.944109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 118/234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:36 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:37.961054 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:37.962417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:37.977078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:37.980423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:37.982387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:37.982868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:38.021016 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:38.249588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:38.267047 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6a5466e8-fa57-4491-a2be-f9d01800e8ce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1318 microversion: 2.1 time: 0.310417 Jun 21 10:00:38.282551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 117/235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:37 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:38.461620 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1821039212", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "998abe51-10aa-4f82-8a14-81e4ec449f6c"}], "security_groups": [{"name": "tempest-securitygroup--831575530"}], "key_name": "tempest-keypair-148919559", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:38.579316 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] validate_networks() for [('998abe51-10aa-4f82-8a14-81e4ec449f6c', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:00:38.843107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:38.843856 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:38.865700 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:38.866918 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:38.868991 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:38.869635 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:38.910204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1fec24f6-3a22-4569-ab26-179bb35e30dc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/ips" status: 200 len: 149 microversion: 2.1 time: 0.072340 Jun 21 10:00:38.911754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 118/236] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:00:38 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:39.299066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:39.299668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:39.307713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:00:39.308179 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:00:39.308656 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:00:39.309258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:00:39.309640 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:00:39.313098 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:39.314045 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:39.316730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:39.320003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:39.321155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:39.349472 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:39.352266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:39.357229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:39.359812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:39.445570 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for project 7a80df511c544924a5708de2513bbc42. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:39.482631 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Getting quotas for user 7e98533664dd4bf6b90e471fc42ba41f and project 7a80df511c544924a5708de2513bbc42. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:39.511480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:00:39.530886 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:00:39.716243 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a6273732-3782-4f04-b346-f62e25400b3d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.249960 Jun 21 10:00:39.724185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 119/237] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:00:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:00:39.735078 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3a9620aa-f865-45d1-a3b6-a8dac2df6fd6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:39.737249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3a9620aa-f865-45d1-a3b6-a8dac2df6fd6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:39.814661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:39.827158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e726f6a8-923c-4ed1-8294-602a19a12efe tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1507 microversion: 2.1 time: 0.531853 Jun 21 10:00:39.828009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 119/238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:39 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1507 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:39.873633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3a9620aa-f865-45d1-a3b6-a8dac2df6fd6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:39.898404 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3a9620aa-f865-45d1-a3b6-a8dac2df6fd6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1245 microversion: 2.1 time: 0.173024 Jun 21 10:00:39.920315 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:39 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:39.937544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:39.938119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:39.966307 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:39.966962 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:39.967780 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:39.968240 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:40.038583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e3084cf2-f2b4-437c-b1d7-f7a43cc2a6b1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/ips" status: 200 len: 145 microversion: 2.1 time: 0.104913 Jun 21 10:00:40.039073 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 120/240] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:00:39 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/ips => generated 145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:40.640667 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05ad1174-dd7a-4449-b50f-94b1b498e3bb"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:40.641808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:40.649526 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:40.650063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:40.651508 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:40.651995 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:40.928819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:40.929643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:40.932517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:40.957126 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:40.957854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:40.958844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:40.959335 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:41.110148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:41.134732 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-89d25ffc-348e-4ab9-8b6a-f97caec1071d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1297 microversion: 2.1 time: 0.209965 Jun 21 10:00:41.139955 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 121/241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:40 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1297 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:41.560041 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a768a8e8-0d8e-4885-9a7d-74f80cab5022 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918253 Jun 21 10:00:41.563289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 121/242] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:00:40 2022] POST /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:42.151845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:42.153294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:42.160300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:42.161092 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:42.162076 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:42.162693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:42.233030 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:42.248220 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3c9c46c3-ac04-438a-9147-906b31d2c317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1303 microversion: 2.1 time: 0.100062 Jun 21 10:00:42.248883 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 122/243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:42 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:43.270106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:43.270803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:43.286677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:43.287480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:43.289102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:43.289836 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:43.449613 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:43.458365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-238a75d6-8680-4024-b05e-8026ec4f01f6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1303 microversion: 2.1 time: 0.195992 Jun 21 10:00:43.459027 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 122/244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:43 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:43.609726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:43.610864 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:43.617774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:43.619102 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:43.620154 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:43.620769 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:43.654346 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-337361d1-2e6c-438e-9aa6-8b8b257cd13a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/ips" status: 200 len: 150 microversion: 2.20 time: 0.048898 Jun 21 10:00:43.655298 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 123/245] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jun 21 10:00:43 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 10:00:44.412792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d006b1ff-c233-4436-8939-773b839a6969"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:44.414538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:44.425367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:44.426330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:44.427778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:44.428827 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:44.479517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:44.483590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:44.493491 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:44.496160 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:44.498176 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:44.498703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:44.661654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:44.671483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0799c09e-ecd8-48c5-8acd-b80a53fd4be2 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.199019 Jun 21 10:00:44.672593 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 124/246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:44 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:44.866820 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cd425b81-4db4-4c59-80b5-a2b899df7839 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451898 Jun 21 10:00:44.869186 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 123/247] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:00:44 2022] POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:45.559261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-9a070d7c-3608-4648-b86e-639d35be3587 req-8df85090-8675-4979-bc21-7d7da77bc383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1006e00-26c8-474c-b97b-8d599dff1cad", "tag": "fa3d5a86-7393-4180-9232-f187e89bd9ea"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:45.593375 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-9a070d7c-3608-4648-b86e-639d35be3587 req-8df85090-8675-4979-bc21-7d7da77bc383 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:45.594481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-9a070d7c-3608-4648-b86e-639d35be3587 req-8df85090-8675-4979-bc21-7d7da77bc383 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:45.620349 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-9a070d7c-3608-4648-b86e-639d35be3587 req-8df85090-8675-4979-bc21-7d7da77bc383 service nova] Creating event network-changed:fa3d5a86-7393-4180-9232-f187e89bd9ea for instance e1006e00-26c8-474c-b97b-8d599dff1cad on hv-cinder-80660 Jun 21 10:00:45.630148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-9a070d7c-3608-4648-b86e-639d35be3587 req-8df85090-8675-4979-bc21-7d7da77bc383 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074427 Jun 21 10:00:45.635944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 125/248] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:45.691532 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:45.692900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:45.712413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:45.712870 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:45.716114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:45.719304 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:46.183665 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:46.197262 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-30ac88de-3b3f-4709-b545-1af91287832d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.512079 Jun 21 10:00:46.201030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 124/249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:45 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:46.765041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:46.780235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:46.785444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:46.790601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:46.791384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:46.792453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:46.793081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:46.820967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lazy-loading 'flavor' on Instance uuid 64e76d7e-1544-4d7d-96d5-6dcca440579d {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:00:47.215761 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:47.216785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:47.226611 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:47.231782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:47.232638 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:47.233095 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:47.434718 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:47.442443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a315d74a-a0f0-49c6-b5e5-d7dff8dab86c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.232219 Jun 21 10:00:47.443315 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 125/250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:47 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:48.458673 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:48.460140 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:48.468916 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:48.469730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:48.470730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:48.471375 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:48.760188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:48.773221 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c1c0281f-3459-456c-81de-ba3d0cae9951 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.318198 Jun 21 10:00:48.774617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 126/251] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:48 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:49.565672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c3c239c9-57b9-48df-9ea6-86a5065d2e6c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: .version_select at 0x7f184af93f70>, body: {"keypair": {"name": "tempest-keypair-1797065958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4Gz46rXzw/8hzXI7mReF+ogopFueV23fNkrQ97OE46pemf+d4tPjFRA9g57ocLzX46x0EOoNf/h1whJyQU8j4Wm36gq7MXThI9vm58+l+JQVI42NoK7sUdsbJowOiAbQ=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:49.575093 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:49.586029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-c3c239c9-57b9-48df-9ea6-86a5065d2e6c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:49.592027 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-c3c239c9-57b9-48df-9ea6-86a5065d2e6c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:49.622648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c3c239c9-57b9-48df-9ea6-86a5065d2e6c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062859 Jun 21 10:00:49.624230 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 127/252] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:00:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:00:49.792359 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:49.795652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:49.807771 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:49.808873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:49.811679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:49.812498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:50.500430 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:50.517511 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e7a2379a-76dc-4a69-b05b-1f6ed10ef6dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.730478 Jun 21 10:00:50.525026 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 128/253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:49 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:51.535819 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:51.536697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:51.544081 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:51.544653 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:51.546006 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:51.546726 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:51.768115 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:51.782654 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cb8914d0-3b96-4437-a2d6-6a5fece9d197 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.251472 Jun 21 10:00:51.783239 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 129/254] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:51 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:52.404484 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571479436", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c994f52e-02e2-4742-8c3a-a41ee59b94bd"}], "security_groups": [{"name": "tempest-securitygroup--1844815809"}], "key_name": "tempest-keypair-1797065958", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:56.307289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] validate_networks() for [('c994f52e-02e2-4742-8c3a-a41ee59b94bd', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:00:56.410670 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ecb3fc76-511d-4175-971a-de714acb28ae tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/action" status: 202 len: 0 microversion: 2.20 time: 9.646785 Jun 21 10:00:56.412547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 126/255] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 10:00:46 2022] POST /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/action => generated 0 bytes in 9650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:00:56.420081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0bec1a9e-696c-4b6b-8744-e95c4e29bc8a req-71b1126b-6d6f-457a-9ced-8962a06e10df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1006e00-26c8-474c-b97b-8d599dff1cad", "name": "network-vif-plugged", "status": "completed", "tag": "fa3d5a86-7393-4180-9232-f187e89bd9ea"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:56.429912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0bec1a9e-696c-4b6b-8744-e95c4e29bc8a req-71b1126b-6d6f-457a-9ced-8962a06e10df service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.431067 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0bec1a9e-696c-4b6b-8744-e95c4e29bc8a req-71b1126b-6d6f-457a-9ced-8962a06e10df service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.447238 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0bec1a9e-696c-4b6b-8744-e95c4e29bc8a req-71b1126b-6d6f-457a-9ced-8962a06e10df service nova] Creating event network-vif-plugged:fa3d5a86-7393-4180-9232-f187e89bd9ea for instance e1006e00-26c8-474c-b97b-8d599dff1cad on hv-cinder-80660 Jun 21 10:00:56.475148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0bec1a9e-696c-4b6b-8744-e95c4e29bc8a req-71b1126b-6d6f-457a-9ced-8962a06e10df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060963 Jun 21 10:00:56.476120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 127/256] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:56.485059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:56.486077 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:56.495721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.496454 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.497443 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.498106 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.666925 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:56.676829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2f3addef-f79e-40a7-b979-4a1459716436 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.198751 Jun 21 10:00:56.689093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 128/257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:56 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:56.694463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:56.695315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:56.702769 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.703422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.704434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.705076 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.931217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:56.935072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:00:56.935799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:00:56.936561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:00:56.939829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:00:56.941772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:00:56.959575 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:56.967455 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.967926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:56.968707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.969597 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bdba72b1-c93b-489f-b9a5-be9e3dff9772 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.279210 Jun 21 10:00:56.969868 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:56.970436 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:56.970661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 129/258] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:00:56 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:00:57.013166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:57.020839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:57.034368 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:00:57.036698 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:00:57.096423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c4126d07-b389-4969-ae38-f752335733ff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.697310 Jun 21 10:00:57.097077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 130/259] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:00:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 4699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:00:57.099023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7167f0bd-f781-45c9-871e-371554529b8e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:57.105716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7167f0bd-f781-45c9-871e-371554529b8e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:57.106162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7167f0bd-f781-45c9-871e-371554529b8e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:57.112535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e36d6440-c99a-4884-b98c-82a7e04cc352 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:57.113425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e36d6440-c99a-4884-b98c-82a7e04cc352 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:57.188811 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e36d6440-c99a-4884-b98c-82a7e04cc352 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:57.199279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e36d6440-c99a-4884-b98c-82a7e04cc352 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1242 microversion: 2.1 time: 0.095835 Jun 21 10:00:57.211071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 131/260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:57 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:57.235027 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7167f0bd-f781-45c9-871e-371554529b8e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Going to try to stop instance {{(pid=117564) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 10:00:57.334868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7167f0bd-f781-45c9-871e-371554529b8e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.239858 Jun 21 10:00:57.335897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 130/261] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:00:57 2022] POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:00:57.345458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:57.346129 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:57.352992 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:57.353446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:57.354220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:57.354655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:57.539224 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:57.559568 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6dc7d72c-e77b-4a98-a21c-231c58e82bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.219754 Jun 21 10:00:57.561312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 132/262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:57 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:57.694632 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:57.695502 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:57.703233 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:57.703816 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:57.704720 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:57.705280 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:57.867865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:57.877953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-90128833-3097-4a90-807b-12671633a972 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1370 microversion: 2.1 time: 0.187608 Jun 21 10:00:57.878520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 131/263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:57 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:57.990999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:57.991661 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:57.998518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:57.998965 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:57.999884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.000362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.119084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-466b420f-0e26-431f-aaf1-23c857239e7a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Action: 'create', calling method: .version_select at 0x7f184ae17790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1601979602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkInnIZYshSLf+8kewhuwNgSxb98YDdCKhbTRCMVlgKOvEYku9lUX33xv8y7cOFKAK9wpjD7mKopO/6B1A8j+jgpo/Ky/ARGL4jDhQHghHk2NYVVToMJSjPwHzdv1/D0A=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:58.148809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-466b420f-0e26-431f-aaf1-23c857239e7a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Getting quotas for project 705097e0a13f400d820a4e6c6720c101. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:58.155192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-466b420f-0e26-431f-aaf1-23c857239e7a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Getting quotas for user cd37e2b041ae441fb1c1ae1d77570820 and project 705097e0a13f400d820a4e6c6720c101. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:58.199087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:58.201056 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:58.201571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-466b420f-0e26-431f-aaf1-23c857239e7a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.085782 Jun 21 10:00:58.202666 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 132/264] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:00:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:00:58.204314 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:58.205585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f9ae0cb7-8442-44a9-a6a2-e95068c1c6d4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.221242 Jun 21 10:00:58.206307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 133/265] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:00:57 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:00:58.220368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:58.221189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:58.228595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.229253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.230227 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.230978 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.329954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1087865678", "imageRef": "307a5314-84b5-44b3-aa2e-ff27a5fcaf90", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1601979602", "networks": [{"uuid": "041eabba-a575-4155-b64e-6b1d812d79a7"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:00:58.403854 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] validate_networks() for [('041eabba-a575-4155-b64e-6b1d812d79a7', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:00:58.448273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:58.457003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-84704f11-e41c-475c-9b0f-7404fd5925e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1246 microversion: 2.1 time: 0.242495 Jun 21 10:00:58.457556 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 133/266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:58 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1246 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:58.578462 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:58.579470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:58.588348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.589842 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.590923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.591558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.623107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:58.744418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:58.752350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-39b39b2a-e0af-4658-a2ad-bb4166ad2b39 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.177613 Jun 21 10:00:58.752905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 134/267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:58 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:58.803143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:00:58.803571 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:00:58.804109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:00:58.804527 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:00:58.804964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:00:58.814597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.815042 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.816168 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.816607 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.834294 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Getting quotas for project 705097e0a13f400d820a4e6c6720c101. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:00:58.839598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Getting quotas for user cd37e2b041ae441fb1c1ae1d77570820 and project 705097e0a13f400d820a4e6c6720c101. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:00:58.853781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:00:58.856005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='307a5314-84b5-44b3-aa2e-ff27a5fcaf90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:00:58.895048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:58.895716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:58.901723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.902434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.903453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:58.903637 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a81e572d-c749-4575-826f-983d38e40ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578895 Jun 21 10:00:58.904476 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:58.909306 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 134/268] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:00:58.916609 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b00576e6-5627-489d-86a5-5e38293dc5d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:58.917296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b00576e6-5627-489d-86a5-5e38293dc5d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:58.974263 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b00576e6-5627-489d-86a5-5e38293dc5d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:58.982717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b00576e6-5627-489d-86a5-5e38293dc5d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1259 microversion: 2.1 time: 0.072301 Jun 21 10:00:58.983298 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 135/269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:58 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:00:59.082722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:59.093018 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-358c0abc-d858-43a3-bb4b-963d533bd248 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1564 microversion: 2.1 time: 0.201984 Jun 21 10:00:59.100457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 135/270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:58 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1564 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:59.110957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:59.111808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:59.119094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.119644 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.120574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.121087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.206103 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-aa00cf83-3984-4a4e-af11-dff42dfff192 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099085 Jun 21 10:00:59.207035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 136/271] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 10:00:59 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:00:59.224617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:59.224792 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:59.231940 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.232436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.233366 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.233927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.474734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:59.475349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:59.481481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.481933 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.482713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.483149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.544935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:59.552801 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c21b8542-ccad-444a-8858-8012fae7fd82 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1294 microversion: 2.1 time: 0.081909 Jun 21 10:00:59.553357 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 137/272] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:59 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:00:59.731127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:59.748904 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:59.750426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:59.751603 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e37e2610-1b43-4739-9fb7-fa1f012335e7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.531339 Jun 21 10:00:59.752255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 136/273] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:00:59 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:00:59.770791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:00:59.771689 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:00:59.779598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.781554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.782639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:00:59.784225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:00:59.788929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:59.927060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:00:59.935544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1c7f4d4d-226e-478b-add8-84b4ca8c1788 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.169626 Jun 21 10:00:59.936119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 138/274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:59 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:00.000299 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:00.000913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:00.007798 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.008315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.009115 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.009550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.074110 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:00.081421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-03aaf474-cffa-48a4-a485-c42fcc4459df tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1255 microversion: 2.1 time: 0.085081 Jun 21 10:01:00.081974 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 137/275] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:00:59 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:00.537665 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-3f81d71d-2475-4d06-af8f-93ba07290d19 req-46a90c31-8f23-49e8-a1d8-922368d72121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1006e00-26c8-474c-b97b-8d599dff1cad", "tag": "fa3d5a86-7393-4180-9232-f187e89bd9ea"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:00.541166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:00.547028 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3f81d71d-2475-4d06-af8f-93ba07290d19 req-46a90c31-8f23-49e8-a1d8-922368d72121 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.547476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3f81d71d-2475-4d06-af8f-93ba07290d19 req-46a90c31-8f23-49e8-a1d8-922368d72121 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.559031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-3f81d71d-2475-4d06-af8f-93ba07290d19 req-46a90c31-8f23-49e8-a1d8-922368d72121 service nova] Creating event network-changed:fa3d5a86-7393-4180-9232-f187e89bd9ea for instance e1006e00-26c8-474c-b97b-8d599dff1cad on hv-cinder-80660 Jun 21 10:01:00.564133 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-3f81d71d-2475-4d06-af8f-93ba07290d19 req-46a90c31-8f23-49e8-a1d8-922368d72121 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030089 Jun 21 10:01:00.565039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 139/276] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:00.570209 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:00.570821 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:00.577321 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.577774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.578535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.578965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.642435 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:00.650768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2899011f-bf51-4c50-8572-bb30dc1431a2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1300 microversion: 2.1 time: 0.084298 Jun 21 10:01:00.651343 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 138/277] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:00 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:00.771021 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:00.771635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:00.777731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.778168 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.778928 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.779360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.936510 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:00.948028 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:00.951858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:00.953143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-714636aa-050c-440b-a6df-adfd2a24e5e6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.186822 Jun 21 10:01:00.953268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:00.954201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:00.964807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 140/278] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:00 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:00.969257 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.973275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:00.974212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:00.977446 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:01.100386 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:01.101005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:01.107502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:01.107953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:01.108951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:01.109563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:01.177010 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:01.186221 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7cf63f62-c90a-4120-8f65-ee5799e1a51b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.236780 Jun 21 10:01:01.198534 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 139/279] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:00 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:01.212659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:01.221316 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dd238a30-a85f-4120-87af-8cfd2b384002 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1319 microversion: 2.1 time: 0.126059 Jun 21 10:01:01.223805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 141/280] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:01 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:01.670258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:01.671060 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:01.680179 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:01.680984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:01.682007 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:01.682624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:01.972931 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:01.974030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:01.985013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:01.991307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:01.993833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:01.994661 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:02.332303 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:02.343709 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:02.345737 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:02.347238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cd1d1ab2-26e7-4c06-8129-2a98ac2e70a5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.379893 Jun 21 10:01:02.348374 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 142/281] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:01 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:02.358148 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:02.364643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:02.383112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:02.384871 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:02.387663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:02.390891 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:02.578558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:02.589775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5bc35a83-63f2-4112-8c00-d9c6e1e65424 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.925174 Jun 21 10:01:02.600795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 140/282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:01 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:02.606769 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:02.608129 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:02.627511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:02.628345 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:02.629536 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:02.630358 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:02.778365 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:02.790401 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b0b95fec-5bf0-4b8a-8f1b-d69bd15a8a72 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1317 microversion: 2.1 time: 0.186737 Jun 21 10:01:02.791806 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 141/283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:02 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:02.827160 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:02.840817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-567eeb52-aa5d-4d23-a46a-c703c1fb65ca tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.490992 Jun 21 10:01:02.853053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 143/284] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:02 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:03.372421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:03.375517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:03.398784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.406194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.409048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.410108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.482843 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-2d56a1f0-db5a-4596-b70d-c359f4aec065 req-0b863be1-7e12-4447-a2d9-2dddab7d9d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2b3d4c-ca98-448e-a982-9d6d673cb24f", "tag": "425ab937-834c-425d-b04e-493460a22a37"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:03.499343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-2d56a1f0-db5a-4596-b70d-c359f4aec065 req-0b863be1-7e12-4447-a2d9-2dddab7d9d10 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.500232 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-2d56a1f0-db5a-4596-b70d-c359f4aec065 req-0b863be1-7e12-4447-a2d9-2dddab7d9d10 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.537232 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-2d56a1f0-db5a-4596-b70d-c359f4aec065 req-0b863be1-7e12-4447-a2d9-2dddab7d9d10 service nova] Creating event network-changed:425ab937-834c-425d-b04e-493460a22a37 for instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f on hv-cinder-80660 Jun 21 10:01:03.543877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-2d56a1f0-db5a-4596-b70d-c359f4aec065 req-0b863be1-7e12-4447-a2d9-2dddab7d9d10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065803 Jun 21 10:01:03.544536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 144/285] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:01:03.609215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:03.612136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:03.628692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.630685 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.633111 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.634712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.666897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:03.677288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:03.680791 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:03.681180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-955cdd04-c0fd-4a92-82c0-f620442a5ff0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.318014 Jun 21 10:01:03.681918 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 142/286] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:03 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:03.810054 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:03.810773 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:03.844612 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.844996 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.845820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.846463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.898828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:03.907167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-69608b10-ac04-40ef-975c-d203402c7f32 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.303369 Jun 21 10:01:03.908743 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 145/287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:03 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:03.922801 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:03.924328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:03.929772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.930223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:03.931585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:03.932117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:04.037326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:04.048154 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-02258050-8c32-48fd-9688-d6a6e9a8f3c0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.242412 Jun 21 10:01:04.049420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 143/288] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:03 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:04.106711 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:04.115815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ca2fe939-1282-4a3d-a45c-33ff87e3ba22 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.197043 Jun 21 10:01:04.118546 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 146/289] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:03 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:04.318243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e99659b9-30ec-497d-adf6-52835e0c1813", "device": "/dev/sdb"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:04.319865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:04.327445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:04.327895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:04.328683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:04.329119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:04.701428 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:04.702001 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:04.708442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:04.708897 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:04.709666 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:04.710107 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:04.842880 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:04.850869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:04.852424 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:04.853583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1fb9fffe-ddc8-4b06-a955-0487de1c1748 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.156151 Jun 21 10:01:04.854202 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 147/290] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:04 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:04.924502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:04.925107 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:04.931735 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:04.932215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:04.932978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:04.933414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:05.077853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:05.086023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9fce3850-e04c-4d29-b528-be2bc283c8da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.165105 Jun 21 10:01:05.087655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 148/291] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:04 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:05.091301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:05.092027 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:05.098269 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:05.098801 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:05.099647 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:05.100618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:05.250896 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:05.259476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5b5f588a-8b96-40bd-8d53-5b0cd6aefc4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.171825 Jun 21 10:01:05.269453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 149/292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:05 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:05.271283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:05.272016 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:05.292256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:05.292697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:05.293477 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:05.293911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:05.421608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:05.429625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0d43d8ab-e15f-4f7d-8e84-d3e73e9a1fb1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.168364 Jun 21 10:01:05.430184 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 150/293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:05 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:05.873118 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:05.873735 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:05.880291 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:05.880697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:05.881464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:05.881902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.007996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:06.016696 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:06.018230 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:06.019449 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-81f329b2-b79e-4b98-8549-b478b2992eca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.150832 Jun 21 10:01:06.020011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 151/294] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:05 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:06.103059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:06.103671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:06.109714 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:06.110158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.110920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:06.111356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.269957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:06.278158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-faab3e30-d990-43f4-b69f-8890eda793fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.179153 Jun 21 10:01:06.283773 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 152/295] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:06 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:06.288399 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:06.289210 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:06.297250 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:06.297741 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.298521 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:06.298964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.426749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:06.434695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bfea62f6-0a94-4f4e-a845-a353814ec739 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.155050 Jun 21 10:01:06.435244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 153/296] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:06 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:06.446123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:06.446660 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:06.452470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:06.452911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.453660 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:06.454121 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:06.598935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:06.608109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-93e39f82-ead3-4ace-bb50-a84cf401d5db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.165404 Jun 21 10:01:06.618951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 154/297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:06 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:07.037754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:07.038448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:07.045589 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.046041 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.046803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.047238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.219025 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:07.227650 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:07.229333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:07.230625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5c8c419c-7aff-424e-9b7e-f5b9c791b363 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.196827 Jun 21 10:01:07.231265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 155/298] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:07 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:07.294550 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:07.295155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:07.301960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.302946 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.303446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.304056 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.309804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:07.448143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:07.455556 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e22ba6f3-97b2-44ab-a040-7e9eb634abb0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.164831 Jun 21 10:01:07.456130 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 156/299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:07 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:07.460421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:07.461022 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:07.467726 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.468269 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.469042 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.469481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.622136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:07.629692 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-da72a665-7550-4ea2-afc8-52c0f7ca3c43 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.172638 Jun 21 10:01:07.630230 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 157/300] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:07 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:07.635203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:07.635799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:07.641266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.641708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.642452 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:07.642881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:07.769629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:07.777527 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-021f6dca-cdd6-4b50-9b79-effba1bfe10a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.146372 Jun 21 10:01:07.778072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 158/301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:07 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:08.166029 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:08.249454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:08.250055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:08.257039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.257475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.258225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.258655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.416364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:08.424745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:08.426286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:08.427468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-63e1ce03-258c-467f-b5ce-7ae98e43ce47 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.181896 Jun 21 10:01:08.428031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 159/302] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:08 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:08.472554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:08.473165 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:08.480566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.481003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.482049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.482550 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.609752 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:08.617332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2e4ec314-3c54-4c8a-aeb5-9678665e3911 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.148590 Jun 21 10:01:08.617880 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 160/303] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:08 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:08.646326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:08.646924 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:08.653413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.653851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.654605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.655040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.780997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:08.788241 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3fdbb0ce-eff1-431c-b9ac-03e3088b59e1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.145339 Jun 21 10:01:08.788797 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 161/304] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:08 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:08.794162 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:08.794769 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:08.800643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.801119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.801894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:08.802333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:08.824832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:08.944385 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:08.953283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f9ab7cc6-9410-446f-a801-4c0679d8ff72 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.162714 Jun 21 10:01:08.953845 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 162/305] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:08 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:09.448818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:09.450602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:09.452765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=28 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:09.462059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:09.462734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:09.463760 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:09.464487 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:09.634181 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:09.642526 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:09.644213 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:09.645214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-05933f4a-3d50-49a4-8354-20290cd12d3c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.200863 Jun 21 10:01:09.652054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 163/306] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:09 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:09.652054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:09.652054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:09.656807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:09.657263 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:09.658136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:09.658577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:09.790931 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:09.798333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f621b0a1-a8b1-4160-9d41-a35a38a9b766 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.151477 Jun 21 10:01:09.799123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 164/307] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:09 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:09.812799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:09.813549 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:09.819679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:09.820171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:09.820977 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:09.821439 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.031913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:10.041482 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1fff103a-d439-4fcb-9426-9d917151a156 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.232392 Jun 21 10:01:10.042422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 165/308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:09 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:10.054376 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:10.054989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:10.078998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:10.079447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.080280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:10.080713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.251306 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:10.260099 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5e52c814-1a53-4949-a373-f07004132969 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.216631 Jun 21 10:01:10.260668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 166/309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:10 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:10.665686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:10.667829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:10.678045 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:10.679096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.680743 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:10.681407 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.817049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:10.825519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:10.827029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:10.829155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-54972e16-30b3-476a-ab29-e1cf95c514e9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.169837 Jun 21 10:01:10.829963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 167/310] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:10 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:10.834406 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:10.835071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:10.841425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:10.841877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.842635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:10.843103 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:10.995140 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:11.002789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bf25ca56-a444-4f70-a071-4da88569e149 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.171834 Jun 21 10:01:11.003553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 168/311] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:10 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:11.059341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:11.060080 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:11.069766 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:11.070186 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:11.071242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:11.071774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:11.234091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:11.241792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6b57f0a0-2d5f-4d33-bee6-6e2fcc7f179a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.187363 Jun 21 10:01:11.242340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 169/312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:11 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:11.277228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:11.277942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:11.283708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:11.284214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:11.284988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:11.285397 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:11.409558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:11.417929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c4fbabbd-e772-4e6d-a93d-ff5930dc9d44 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.144967 Jun 21 10:01:11.418481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 170/313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:11 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:11.847061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:11.847802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:11.854355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:11.854806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:11.855574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:11.856035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:11.996852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:12.005207 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:12.006880 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:12.008232 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4e18b728-d4eb-400e-8601-0f1fabfb9625 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.165152 Jun 21 10:01:12.009567 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 171/314] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:11 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:12.023443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:12.024258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:12.030571 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:12.031142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:12.032069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:12.032614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:12.167016 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:12.170478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:12.175540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1a675074-6898-4281-923a-a4220ed5d822 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.160598 Jun 21 10:01:12.176121 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 172/315] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:12 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:12.260600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:12.261415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:12.275198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:12.275785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:12.277112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:12.277624 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:12.432031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:12.444497 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-47df9eca-8403-4d70-89d3-dcffac3f36a0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.188415 Jun 21 10:01:12.445763 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 173/316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:12 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:12.451152 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:12.452184 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:12.458958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:12.459705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:12.460734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:12.461332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:12.817812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:12.826189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-83d664b5-6351-4dae-b681-7a58a95d201b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.378693 Jun 21 10:01:12.826746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 174/317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:12 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:13.026684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:13.027311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:13.034047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.034502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.035287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.035727 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.181920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:13.190590 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:13.192117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:13.193446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6995e32a-eb6a-47af-bead-a920af8255f8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.170742 Jun 21 10:01:13.198345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 175/318] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:13 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:13.199047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:13.199660 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:13.205882 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.206339 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.207108 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.207546 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.341227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:13.348854 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d90d74ce-18d9-4865-b0ad-f3ad077994b8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.153606 Jun 21 10:01:13.349409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 176/319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:13 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:13.464244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:13.465036 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:13.472025 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.472898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.473323 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.473826 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.631928 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:13.641898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fa582bd4-d065-4132-a980-945c204b5b0f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.181767 Jun 21 10:01:13.652216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 177/320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:13 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:13.844075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:13.844684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:13.851341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.851792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.853281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:13.853714 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:13.988020 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:13.996246 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-37297e58-9191-4eb3-a8af-862458fd4e13 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.156989 Jun 21 10:01:13.996793 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 178/321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:13 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:14.212504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:14.213157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:14.219763 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:14.220254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:14.221030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:14.221470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:14.323662 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:14.400459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:14.403327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=62 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:14.416605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:14.419143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:14.421142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6fe1d1c6-e4f9-4bd4-a1b3-87888d866780 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.212771 Jun 21 10:01:14.422217 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 179/322] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:14 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:14.432208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:14.433161 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:14.442488 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:14.443046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:14.443990 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:14.444581 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:14.593677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:14.601132 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0862d954-df29-4225-85f7-3d3306602d9b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.177391 Jun 21 10:01:14.601678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 180/323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:14 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:14.660234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:14.660777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:14.667284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:14.667729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:14.668516 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:14.668957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:14.800984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:14.809127 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1c277e8a-fe87-45fa-add6-d6b20c39ab9a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.152940 Jun 21 10:01:14.809684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 181/324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:14 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:15.013296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:15.013903 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:15.019917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.020393 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.021146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.021576 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.153094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:15.161074 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-298ea002-b9c1-41f0-bacd-9b7a644f56db tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.151588 Jun 21 10:01:15.161621 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 182/325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:15 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:15.440354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:15.441017 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:15.447825 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.448297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.449052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.449482 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.580127 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:15.589066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:15.590710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:15.591892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-658b844e-6c10-4506-bc6a-63c315b7f1d2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.155603 Jun 21 10:01:15.597350 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 183/326] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:15 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:15.618444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:15.619213 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:15.626164 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.626618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.627389 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.627888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.760907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:15.768966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1dce3204-dded-45dc-a69e-a6bda17991de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.154316 Jun 21 10:01:15.769560 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 184/327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:15 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:15.826245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:15.826849 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:15.833020 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.833463 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.834217 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:15.834648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:15.966137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:15.973846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-440ba569-dcee-4354-abcd-eb01ba60d12f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.151962 Jun 21 10:01:15.980319 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 185/328] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:15 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:16.178940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:16.179553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:16.186198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.186649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.187420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.187922 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.320966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:16.335290 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d22b825b-f307-4f71-a584-337f1a761469 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.160000 Jun 21 10:01:16.335920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 186/329] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:16 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:16.505693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eba8f998-d3ff-4312-9966-e32e654415eb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "POST /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.191131 Jun 21 10:01:16.514963 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 144/330] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:01:04 2022] POST /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb/os-volume_attachments => generated 194 bytes in 12201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:16.614490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:16.615162 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:16.630063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.631344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.632930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.633467 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.788985 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:16.789797 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:16.795077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:16.799027 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.799563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.800612 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.800944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.804201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:16.809996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:16.812126 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d6ab1829-6970-4eb0-91b5-cd0a7d6b447d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1741 microversion: 2.20 time: 0.204286 Jun 21 10:01:16.813236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 187/331] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:16 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:16.819317 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-9893ca60-133b-46e9-9353-8aca7d3785a7 req-ad94234a-6ce5-409e-a9bf-273e66b4c20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:16.842714 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9893ca60-133b-46e9-9353-8aca7d3785a7 req-ad94234a-6ce5-409e-a9bf-273e66b4c20a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:16.843354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9893ca60-133b-46e9-9353-8aca7d3785a7 req-ad94234a-6ce5-409e-a9bf-273e66b4c20a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:16.857128 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-9893ca60-133b-46e9-9353-8aca7d3785a7 req-ad94234a-6ce5-409e-a9bf-273e66b4c20a service nova] Creating event network-changed:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:01:16.862618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-9893ca60-133b-46e9-9353-8aca7d3785a7 req-ad94234a-6ce5-409e-a9bf-273e66b4c20a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048013 Jun 21 10:01:16.863219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 188/332] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:16.983731 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:16.991387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:16.992205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:16.993026 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bfb79166-078d-4511-be29-1c1ad207c41a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.210355 Jun 21 10:01:16.995166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 145/333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:16 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:16.996123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:17.030154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:17.032814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:17.035420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:17.037041 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:17.196879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:17.205267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bc61fc9a-c43e-4b4a-aebb-f36e7dfac1ce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.218272 Jun 21 10:01:17.206033 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 189/334] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:16 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:17.353002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:17.353628 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:17.361955 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:17.362512 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:17.363365 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:17.363878 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:17.662386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:17.671247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-93c48cfd-f1c5-4a31-84a3-c7de610f27f4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.322140 Jun 21 10:01:17.672191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 146/335] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:17 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:17.830757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:17.831385 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:17.838152 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:17.838604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:17.839583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:17.840267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:17.844737 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:17.973161 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:17.981994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:17.983480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:17.984695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-05a954ac-9d84-4892-a49b-2f9b97eaf1ca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1741 microversion: 2.20 time: 0.157970 Jun 21 10:01:17.985254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 190/336] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:17 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:18.012629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:18.013303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:18.020329 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.020786 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.021545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.021978 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.158727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:18.166801 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9026545a-2743-46ab-9a69-ff97f97595cd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.157447 Jun 21 10:01:18.167347 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 147/337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:18 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:18.222562 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:18.223169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:18.229798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.230238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.230991 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.231421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.361525 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:18.369380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fe12b34f-c486-4b6e-a88e-86bc8149c3a8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.150465 Jun 21 10:01:18.369955 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 191/338] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:18 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:18.527691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-dca24cc3-f87c-43d3-b70f-5d8c12928070 req-9cdd9f7a-ea82-4ce2-a0b9-77951b05005c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "name": "network-vif-plugged", "status": "completed", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:18.536381 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dca24cc3-f87c-43d3-b70f-5d8c12928070 req-9cdd9f7a-ea82-4ce2-a0b9-77951b05005c service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.536841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dca24cc3-f87c-43d3-b70f-5d8c12928070 req-9cdd9f7a-ea82-4ce2-a0b9-77951b05005c service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.547829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-dca24cc3-f87c-43d3-b70f-5d8c12928070 req-9cdd9f7a-ea82-4ce2-a0b9-77951b05005c service nova] Creating event network-vif-plugged:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 10:01:18.552620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-dca24cc3-f87c-43d3-b70f-5d8c12928070 req-9cdd9f7a-ea82-4ce2-a0b9-77951b05005c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029105 Jun 21 10:01:18.553201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 148/339] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:18.691011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:18.691622 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:18.698275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.698798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.699570 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:18.700070 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:18.829051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:18.837820 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-27bd3fff-5ba5-4a1a-b54f-34e7f3ae8d41 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.150475 Jun 21 10:01:18.838507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 192/340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:18 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:19.003245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:19.003942 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:19.010962 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.011551 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.012358 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.012796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.177429 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:19.183011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:19.183633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:19.191814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.192284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.192827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:19.193053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.193480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.194931 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:19.196817 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-66d8212a-ec03-42de-ac48-43d21c14bf06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1741 microversion: 2.20 time: 0.197288 Jun 21 10:01:19.197668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 149/341] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:18 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:19.336535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:19.344638 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bfae7ddd-ee8b-48d8-bde6-bf85cefe5014 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.165898 Jun 21 10:01:19.345228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 193/342] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:19 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:19.387024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:19.387639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:19.394097 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.398434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.398434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.398434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.529231 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:19.536649 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2b2cf306-1229-4b13-8cee-69aff14d62d2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.153868 Jun 21 10:01:19.537208 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 150/343] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:19 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:19.854442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:19.855165 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:19.861537 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.862231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.863012 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:19.863443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:19.995190 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:20.003296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-172cfe09-3dcc-4f2b-8fe5-f9e75be202ea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1723 microversion: 2.1 time: 0.152685 Jun 21 10:01:20.003857 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 194/344] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:19 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:20.215363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:20.215996 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:20.222496 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:20.223034 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:20.223799 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:20.224261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:20.352148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:20.360703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:20.362409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:20.362540 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:20.363175 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:20.363617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4ac94ffe-2524-485a-aef9-90718133815c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1741 microversion: 2.20 time: 0.152904 Jun 21 10:01:20.364191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 151/345] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:20 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:20.369980 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:20.370686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:20.371617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:20.372078 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:20.500704 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:20.508531 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e775e8d1-4e78-474d-b41a-88f9a490ec26 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.150263 Jun 21 10:01:20.509387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 195/346] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:20 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:20.554463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:20.555210 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:20.561678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:20.562143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:20.562932 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:20.563378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:20.694709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:20.702252 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c6176a3d-f987-45dc-9161-f84cf8ae1b88 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.151551 Jun 21 10:01:20.702743 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 152/347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:20 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:21.022787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:21.023385 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:21.031783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.032419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.033355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.033937 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.181154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.190257 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ee41d984-621e-44ca-a026-6bd0fce22972 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1700 microversion: 2.1 time: 0.171316 Jun 21 10:01:21.190819 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 196/348] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:21 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:21.207478 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c535161-587a-44c5-9cb0-8be3ab53267a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:21.214717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c535161-587a-44c5-9cb0-8be3ab53267a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.215220 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c535161-587a-44c5-9cb0-8be3ab53267a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.238219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8c535161-587a-44c5-9cb0-8be3ab53267a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Going to try to start instance {{(pid=117564) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 10:01:21.285916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c535161-587a-44c5-9cb0-8be3ab53267a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.082207 Jun 21 10:01:21.286423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 153/349] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:01:21 2022] POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:01:21.295253 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:21.295947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:21.303088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.303531 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.304451 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.304784 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.383224 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:21.383968 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:21.392260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.392717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.393500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.393941 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.438094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.448383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-07bbd7c2-3212-4436-8f53-7b5a51051683 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1709 microversion: 2.1 time: 0.157373 Jun 21 10:01:21.449299 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 197/350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:21 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:21.526926 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:21.527542 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:21.534029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.534480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.535249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.535686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.569671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.582656 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.584494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.585765 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0ea27bf0-148c-46a0-9e26-b1576fd7c730 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1741 microversion: 2.20 time: 0.206874 Jun 21 10:01:21.586399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 154/351] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:21 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:21.672468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.680320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d2279a78-005d-4e89-a7d6-b838e1a6f8a3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.157898 Jun 21 10:01:21.680893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 198/352] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:21 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:21.719239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:21.720190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:21.726524 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.727084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.727769 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:21.728230 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:21.934348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:21.941493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-581ce4cf-09b3-48fe-aa62-9c047e967796 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.226207 Jun 21 10:01:21.942116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 155/353] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:21 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:22.467133 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:22.468883 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:22.478300 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.479837 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.481628 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.482245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.609589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:22.610204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:22.633680 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.634152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.635165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.635624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.704589 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:22.716871 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1798d502-7cee-45f8-a744-90517c9695d6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1709 microversion: 2.1 time: 0.254233 Jun 21 10:01:22.717442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 199/354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:22 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:22.731362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:22.734388 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:22.757675 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.759496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.760753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.761782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.833916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:22.844700 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:22.847280 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:22.851195 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-da216f01-c185-44db-8136-1217a24ab035 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.249274 Jun 21 10:01:22.854620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 156/355] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:22 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:22.864710 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-e4d5d50f-cc93-4669-852a-e0f893aa64c6 req-32e52c45-fc95-4c70-8b4a-e1d7924d883d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2b3d4c-ca98-448e-a982-9d6d673cb24f", "name": "network-vif-plugged", "status": "completed", "tag": "425ab937-834c-425d-b04e-493460a22a37"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:22.881759 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e4d5d50f-cc93-4669-852a-e0f893aa64c6 req-32e52c45-fc95-4c70-8b4a-e1d7924d883d service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.883705 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e4d5d50f-cc93-4669-852a-e0f893aa64c6 req-32e52c45-fc95-4c70-8b4a-e1d7924d883d service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.914573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-e4d5d50f-cc93-4669-852a-e0f893aa64c6 req-32e52c45-fc95-4c70-8b4a-e1d7924d883d service nova] Creating event network-vif-plugged:425ab937-834c-425d-b04e-493460a22a37 for instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f on hv-cinder-80660 Jun 21 10:01:22.923663 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-e4d5d50f-cc93-4669-852a-e0f893aa64c6 req-32e52c45-fc95-4c70-8b4a-e1d7924d883d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067727 Jun 21 10:01:22.924315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 157/356] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:22.948843 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:22.957877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-98201176-9bea-4d15-83bc-66f31835f0e8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.232566 Jun 21 10:01:22.958888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 200/357] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:22 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:22.960483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:22.961936 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:22.973139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.973925 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:22.975143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:22.975773 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:23.141256 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:23.151104 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-363f893f-4536-4130-95fb-4e3e33242651 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.195516 Jun 21 10:01:23.151865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 158/358] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:22 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:23.735913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:23.737468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:23.744700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:23.745158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:23.746066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:23.746503 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:23.875238 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:23.876210 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:23.890885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:23.891337 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:23.892149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:23.892755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:23.902018 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:23.912258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c84f0f2d-583a-4314-bde5-3b695fdad1f9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1713 microversion: 2.1 time: 0.179992 Jun 21 10:01:23.912469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 201/359] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:23 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1713 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:23.976587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:23.977203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:23.993727 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:23.994227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:23.995017 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:23.995459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:24.197277 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:24.206539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d466e2ed-2740-4166-9ca5-d3fd1568c2b0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.233544 Jun 21 10:01:24.207937 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 202/360] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:23 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:24.222272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:24.223321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:24.230231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:24.230677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:24.231464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:24.231897 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:24.354708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:24.364053 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:24.365549 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:24.366917 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0efb4a62-1baf-4344-9a6f-ae2c91a5fa68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.497629 Jun 21 10:01:24.367945 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 159/361] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:23 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:24.418474 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:24.426743 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e97ab985-7b06-4fbf-9d07-340e44384c48 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.217356 Jun 21 10:01:24.427645 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 203/362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:24 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:25.224828 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:25.224828 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:25.232287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.238182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.239070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.239543 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.278626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-514736ab-9d47-45b3-b485-52147e1aeb90 req-c3748498-d003-46ab-a619-3828efe98117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "name": "network-vif-plugged", "status": "completed", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:25.280942 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:25.294270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-514736ab-9d47-45b3-b485-52147e1aeb90 req-c3748498-d003-46ab-a619-3828efe98117 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.294723 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-514736ab-9d47-45b3-b485-52147e1aeb90 req-c3748498-d003-46ab-a619-3828efe98117 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.317580 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-514736ab-9d47-45b3-b485-52147e1aeb90 req-c3748498-d003-46ab-a619-3828efe98117 service nova] Creating event network-vif-plugged:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:01:25.325513 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-514736ab-9d47-45b3-b485-52147e1aeb90 req-c3748498-d003-46ab-a619-3828efe98117 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049159 Jun 21 10:01:25.326778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 204/363] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:25.386544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:25.387302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:25.394543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.394887 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.395906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.397109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.460858 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:25.472550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5b5f7163-2b76-4c85-835a-0d3787d92049 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.252165 Jun 21 10:01:25.473250 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 160/364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:25 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:25.479812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:25.480598 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:25.487278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.487734 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.488558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:25.488998 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:25.575227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:25.584311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:25.586047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:25.587315 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2a5fd1da-75cd-47df-b7bb-d90390f0b128 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.205568 Jun 21 10:01:25.588513 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 205/365] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:25 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:25.661981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:25.671750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d58f8508-ddc4-4681-bcf7-a8acc3877d79 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.196967 Jun 21 10:01:25.672640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 161/366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:25 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:26.490781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:26.491543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:26.503037 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:26.503493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:26.504322 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:26.504756 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:26.606363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:26.606968 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:26.613849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:26.614292 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:26.615063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:26.615878 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:26.705641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:26.714278 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-11ba002a-52b3-4019-9234-ee15f023f1fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1368 microversion: 2.1 time: 0.226491 Jun 21 10:01:26.718707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 206/367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:26 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:26.724888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:26.727618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:26.743218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:26.744368 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:26.745366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:26.746049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:26.778852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:26.851306 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:26.860808 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:26.863578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:26.865117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e4fc975c-98c2-470b-9eff-de47e83659be tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.262783 Jun 21 10:01:26.876752 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 162/368] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:26 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:26.922344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:26.935547 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5ba6cc6a-ccc4-4fbf-abbc-58a51e7115bb tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.214459 Jun 21 10:01:26.939698 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 207/369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:26 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:27.735842 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:27.736535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:27.743493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:27.743949 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:27.744823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:27.745382 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:27.888163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:27.888959 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:27.895736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:27.896370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:27.897407 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:27.897928 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:27.903052 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:27.912613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f61629c8-f529-4d5e-9d3c-86b876fdc8be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1558 microversion: 2.1 time: 0.180851 Jun 21 10:01:27.913732 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 163/370] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:27 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:27.931186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:27.932152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:27.942170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:27.942668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:27.943677 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:27.944167 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:28.114517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ddcccc81-7448-4317-b39f-8aa7613f53b3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188069 Jun 21 10:01:28.120927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 164/371] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 10:01:27 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:01:28.120927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:28.120927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:28.127023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:28.127470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:28.128981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:28.129424 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:28.147610 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:28.169557 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:28.171313 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:28.172528 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-34048c85-cbf2-4579-aaf5-18777af218b3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.293175 Jun 21 10:01:28.173272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 208/372] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:27 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:28.423912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:28.437107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-55f993f4-1f75-4107-b324-af91bd4154a1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.320931 Jun 21 10:01:28.437678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 165/373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:28 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:29.190659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:29.191657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:29.201904 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:29.202696 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:29.204326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:29.204973 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:29.267368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-c06353d6-4520-472f-940d-5d7524a1589a req-ae6903c0-7fc4-4d0d-b4be-db525bbde7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2b3d4c-ca98-448e-a982-9d6d673cb24f", "tag": "425ab937-834c-425d-b04e-493460a22a37"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:29.278034 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-c06353d6-4520-472f-940d-5d7524a1589a req-ae6903c0-7fc4-4d0d-b4be-db525bbde7b3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:29.278843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-c06353d6-4520-472f-940d-5d7524a1589a req-ae6903c0-7fc4-4d0d-b4be-db525bbde7b3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:29.290723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-c06353d6-4520-472f-940d-5d7524a1589a req-ae6903c0-7fc4-4d0d-b4be-db525bbde7b3 service nova] Creating event network-changed:425ab937-834c-425d-b04e-493460a22a37 for instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f on hv-cinder-80660 Jun 21 10:01:29.299135 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-c06353d6-4520-472f-940d-5d7524a1589a req-ae6903c0-7fc4-4d0d-b4be-db525bbde7b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035166 Jun 21 10:01:29.303823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 166/374] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:29.385712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:29.394805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:29.401062 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:29.405801 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cb569841-2b82-469e-9b32-58fd97d8278e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.218204 Jun 21 10:01:29.413717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 209/375] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:29 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:29.460332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:29.461044 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:29.472957 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:29.473961 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:29.475303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:29.475561 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:29.648426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:29.656954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c66729ca-6708-489a-80e6-c3fbecdf387b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.202904 Jun 21 10:01:29.657967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 167/376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:29 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:30.425119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:30.426447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:30.434557 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:30.435354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:30.436405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:30.437040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:30.582201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:30.591893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:30.593656 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:30.595325 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d61eaf30-11ba-4105-bc16-69177ff92445 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.174143 Jun 21 10:01:30.596054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 210/377] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:30 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:30.674281 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:30.674899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:30.681839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:30.682764 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:30.683307 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:30.683864 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:30.854644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:30.862872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-49dd561d-5f93-4971-ba8c-8e98135ee232 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.192406 Jun 21 10:01:30.863447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 168/378] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:30 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:31.618853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:31.620370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:31.628435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:31.628890 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:31.630123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:31.630574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:31.796219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:31.805717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:31.807402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:31.808864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6141e47a-f564-4c2d-ac33-4e2d3077b838 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.193838 Jun 21 10:01:31.810185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 211/379] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:31 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:31.880178 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:31.880902 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:31.888247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:31.888832 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:31.889666 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:31.890188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:32.018591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:32.026291 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-504fa512-5da1-4001-82dd-d8ed9651db7b tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.150043 Jun 21 10:01:32.026848 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 169/380] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:31 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:32.828233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:32.828840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:32.834829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:32.835270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:32.836046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:32.836484 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:32.964847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:32.972565 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:32.974057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:32.975199 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6236d169-7953-4d67-8c28-2962bbad1ac3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.151015 Jun 21 10:01:32.975736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 212/381] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:32 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:33.043129 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:33.043742 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:33.050189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:33.050631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:33.051384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:33.051815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:33.176694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:33.184492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2cbed7c8-fe56-4f37-87a2-9ef486eed83a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.145213 Jun 21 10:01:33.185037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 170/382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:33 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:33.993256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:33.993858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:34.000275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:34.000719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:34.001478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:34.001909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:34.125963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:34.133702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:34.135679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:34.136840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2f1a8e40-b882-4914-9c00-b7bf25b77416 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.147442 Jun 21 10:01:34.137380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 213/383] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:33 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:34.201739 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:34.202284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:34.208755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:34.209203 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:34.209965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:34.210403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:34.339108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:34.346455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8452d08c-64a7-4e78-972b-9ec584debad5 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.149068 Jun 21 10:01:34.347013 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 171/384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:34 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:35.154789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:35.155360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:35.161957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:35.162403 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:35.163154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:35.163584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:35.293966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:35.301721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:35.303195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:35.304374 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b16c967f-4f48-4736-98f1-7941a355908e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1736 microversion: 2.20 time: 0.153486 Jun 21 10:01:35.304917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 214/385] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:35 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:35.362746 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:35.363357 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:35.369601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:35.370046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:35.370803 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:35.371239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:35.494526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:35.502537 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3b063630-ed3f-4cb5-a416-a19f459ad9ad tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.143911 Jun 21 10:01:35.503092 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 172/386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:35 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:36.322860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:36.323465 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:36.329925 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:36.330370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:36.331135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:36.331555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:36.456079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:36.464111 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:36.465616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:36.466812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1bb01a6a-8b35-44f4-ad23-0e8b6f37d18d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.148439 Jun 21 10:01:36.467358 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 215/387] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:36 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:36.518937 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:36.519547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:36.526051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:36.526496 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:36.527255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:36.527689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:36.657947 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:36.665329 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f4e4588e-f1fc-422f-9098-049ed8446ca3 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1359 microversion: 2.1 time: 0.150180 Jun 21 10:01:36.666401 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 173/388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:36 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:37.271502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-8e99afed-7ccc-46c1-9b41-24debaf2e7e6 req-5a6bcd98-6ee4-449e-9665-69f6d08ed76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "name": "network-vif-unplugged", "status": "completed", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:37.280337 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8e99afed-7ccc-46c1-9b41-24debaf2e7e6 req-5a6bcd98-6ee4-449e-9665-69f6d08ed76e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.280802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8e99afed-7ccc-46c1-9b41-24debaf2e7e6 req-5a6bcd98-6ee4-449e-9665-69f6d08ed76e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.291630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-8e99afed-7ccc-46c1-9b41-24debaf2e7e6 req-5a6bcd98-6ee4-449e-9665-69f6d08ed76e service nova] Creating event network-vif-unplugged:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 10:01:37.296545 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-8e99afed-7ccc-46c1-9b41-24debaf2e7e6 req-5a6bcd98-6ee4-449e-9665-69f6d08ed76e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028674 Jun 21 10:01:37.297143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 216/389] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:37.485163 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:37.485770 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:37.492197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.492683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.493447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.494399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.683958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:37.684681 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:37.690814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.691260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.692054 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.692493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.697716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:37.705675 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:37.707215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:37.708420 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3c3913ee-4e73-44be-b906-a0f681d07511 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.227144 Jun 21 10:01:37.708979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 174/390] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:37 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:37.824046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:37.831427 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f563dbea-43bb-44f7-a4ad-c3d9bd890ac9 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1549 microversion: 2.1 time: 0.152674 Jun 21 10:01:37.832024 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 217/391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:37 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:37.847750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:37.848397 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:37.855042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.855518 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.856339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:37.856778 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:37.991314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:37.999399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b99acd71-963b-4f58-a9dd-1b1c425602e6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1549 microversion: 2.1 time: 0.155449 Jun 21 10:01:37.999954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 175/392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:37 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:38.014560 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:38.017970 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:38.018735 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Searching by: {'deleted': False, 'project_id': '705097e0a13f400d820a4e6c6720c101'} {{(pid=117563) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 10:01:38.025352 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:38.025803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:38.026605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:38.027043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:38.115965 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.multi_cell_list [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 10:01:38.211524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-78ec988f-e007-4609-8666-05b3ec9d7c7e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200576 Jun 21 10:01:38.212123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 218/393] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Jun 21 10:01:38 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:38.222585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:38.223196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:38.229825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:38.230271 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:38.231018 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:38.231472 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:38.357187 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:38.364912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d4ed088e-bcb9-4599-8761-70f116cdacf8 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1549 microversion: 2.1 time: 0.146176 Jun 21 10:01:38.365466 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 176/394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:38 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:38.726398 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:38.727006 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:38.733361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:38.733931 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:38.734784 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:38.735370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:38.865802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:38.873867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:38.875359 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:38.876552 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c9796acb-5d52-4cfb-a7c0-c91953016a17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.154407 Jun 21 10:01:38.877101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 219/395] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:38 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:39.895355 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:39.895991 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:39.903174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:39.903624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:39.904426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:39.904866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:40.030423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:40.038262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:40.039756 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:40.041579 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b27422c2-977b-40e2-a1d3-dcb6854fb796 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.150151 Jun 21 10:01:40.042130 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 177/396] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:39 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:41.059318 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:41.060023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:41.066699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:41.067227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:41.068093 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:41.068599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:41.276606 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:41.286994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:41.288929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:41.295783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a2498f94-3a30-40f5-b2f4-607c9a62d042 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.240325 Jun 21 10:01:41.306603 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 220/397] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:41 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:41.961255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f927bf1d-0798-4a37-9be9-47b94a1f9c0a"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:41.962338 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:41.969389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:41.969831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:41.970584 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:41.971017 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:41.974733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:42.313712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:42.314234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:42.320616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:42.321063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:42.322691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:42.323128 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:42.464791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:42.472647 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:42.474138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:42.475296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8c4cff2c-b938-4e71-904c-c844e9f06059 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.165566 Jun 21 10:01:42.475848 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 221/398] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:42 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:43.493492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:43.494096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:43.500553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:43.500918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:43.501708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:43.502144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:43.636787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:43.644978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:43.646505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:43.647797 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1e6c71c3-8aa3-40d9-a7d1-f1739430ecec tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1718 microversion: 2.20 time: 0.158329 Jun 21 10:01:43.648540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 222/399] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:43 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:43.927014 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a7f4970a-af7e-4453-b3ca-0b0523e40dbc tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.969470 Jun 21 10:01:43.927721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 178/400] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:01:41 2022] POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments => generated 194 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:44.667143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:44.667691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:44.674297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:44.674727 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:44.675491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:44.675929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:44.802613 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:44.811124 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:44.812636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:44.813772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8e594a9b-50a1-4d9b-923d-4133540c4372 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1721 microversion: 2.20 time: 0.151118 Jun 21 10:01:44.814316 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 223/401] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:44 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:44.832386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff0c222-b6c5-4147-af73-a8b1e9d505f3"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:44.833610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:44.835586 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=69 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:44.840973 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:44.841422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:44.842187 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:44.842623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.126880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-638d8d13-61eb-4a57-adb7-0b88ff9d87d0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299509 Jun 21 10:01:45.129038 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 179/402] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jun 21 10:01:44 2022] POST /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:01:45.309954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:45.310519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:45.316413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:45.316858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.317615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:45.318053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.335186 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:45.408649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3b7d23dd-60ab-4e7d-b8cf-e4b05a11ed39 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/action" status: 202 len: 0 microversion: 2.20 time: 0.102553 Jun 21 10:01:45.409351 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 224/403] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 10:01:45 2022] POST /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:01:45.417436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:45.418049 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:45.424687 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:45.425132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.425897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:45.426322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.562177 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:45.573024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:45.575132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:45.575891 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-596d2509-3f9b-4e05-aa33-016a63719cc1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1747 microversion: 2.20 time: 0.162365 Jun 21 10:01:45.576466 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 180/404] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:45 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:45.635558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:45.636086 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:45.642458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:45.642598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.643301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:45.643736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:45.775787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lazy-loading 'services' on Instance uuid ea8350f7-d196-4024-aff3-344819dfc6fb {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:01:45.893328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6addf9f9-4cfb-4c8d-a9ad-bc0888cf1fc9 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb/os-volume_attachments/e99659b9-30ec-497d-adf6-52835e0c1813" status: 202 len: 0 microversion: 2.1 time: 0.262152 Jun 21 10:01:45.893901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 225/405] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:01:45 2022] DELETE /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb/os-volume_attachments/e99659b9-30ec-497d-adf6-52835e0c1813 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:01:46.593905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:46.594457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:46.600632 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:46.601077 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:46.601824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:46.602256 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:46.949069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:46.957494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:46.959361 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:46.960547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-69fc2cc5-50c3-49bc-9d21-127a174cbb0f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.370691 Jun 21 10:01:46.961247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 181/406] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:46 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:47.981424 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:47.982155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:47.984292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=76 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:47.990071 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:47.990517 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:47.991273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:47.991874 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:48.058853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:48.162655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:48.171796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:48.173322 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:48.174478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9638d23e-a23e-4394-bb1c-0cb7b0bba2c2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.198753 Jun 21 10:01:48.175075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 226/407] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:47 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:49.192661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:49.193264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:49.200514 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:49.200954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:49.201704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:49.202132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:49.331342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:49.340244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:49.341725 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:49.342898 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1d9209ca-3703-4da4-98d5-a7398efab1b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.154254 Jun 21 10:01:49.343489 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 182/408] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:49 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:50.360791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:50.361435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:50.368223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:50.368677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:50.369535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:50.369973 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:50.499060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:50.507181 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:50.508687 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:50.509832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c1bdbd35-aaa5-4bb0-87bc-7059489c5e01 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.152896 Jun 21 10:01:50.510376 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 227/409] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:50 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:01:51.527623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:51.528251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:51.534779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:51.535227 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:51.536005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:51.536433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:51.662491 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:51.671277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:51.672799 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:51.673952 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-85e59815-fe38-4a32-b7ec-398e926a5116 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.150226 Jun 21 10:01:51.674498 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 183/410] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:51 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:52.693335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:52.693850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:52.701884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:52.702329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:52.703113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:52.703544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:52.830043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:52.838217 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:52.840051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:52.841205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-16f4ad9f-961a-4325-93a7-596ceb3fbb4b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.152608 Jun 21 10:01:52.841753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 228/411] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:52 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:53.859665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:53.860307 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:53.867451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:53.867903 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:53.868722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:53.869156 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:53.998408 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:54.006702 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:54.008236 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:54.009387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f9987df9-ee77-4994-85e7-b41c6b645efc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.153723 Jun 21 10:01:54.009935 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 184/412] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:53 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:54.665371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:54.665982 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:54.672918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:54.673366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:54.674114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:54.674558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:54.796686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:54.806221 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8e1f3a5e-0349-4eb5-adc0-64d57b1c4e18 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1595 microversion: 2.1 time: 0.144402 Jun 21 10:01:54.807246 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 229/413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:54 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1595 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:01:55.028615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:55.029837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:55.036732 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:55.037199 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:55.037947 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:55.038379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:55.172730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:55.181149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:55.182657 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:55.183854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d7b102e9-81db-441e-8279-bc85621f11e5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.159836 Jun 21 10:01:55.184444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 185/414] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:55 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:56.201932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:56.202449 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:56.208894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:56.209340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:56.210108 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:56.210550 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:56.401122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:56.410237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:56.411715 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:56.412902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b7765fd9-97a3-4694-b56c-2a0592bda983 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.214936 Jun 21 10:01:56.413448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 230/415] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:56 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:56.555704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-b5242a9b-972d-462c-9a3a-d573cd441ceb req-16fc8030-da65-49ac-b729-287e93acd60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:56.565282 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-b5242a9b-972d-462c-9a3a-d573cd441ceb req-16fc8030-da65-49ac-b729-287e93acd60a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:56.565911 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-b5242a9b-972d-462c-9a3a-d573cd441ceb req-16fc8030-da65-49ac-b729-287e93acd60a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:56.578051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-b5242a9b-972d-462c-9a3a-d573cd441ceb req-16fc8030-da65-49ac-b729-287e93acd60a service nova] Creating event network-changed:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:01:56.583427 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-b5242a9b-972d-462c-9a3a-d573cd441ceb req-16fc8030-da65-49ac-b729-287e93acd60a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031443 Jun 21 10:01:56.584048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 186/416] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:57.431118 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:57.431725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:57.438865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:57.439320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:57.440131 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:57.440571 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:57.629447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:57.639418 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:57.640950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:57.642198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-842cf10e-f760-49fc-b005-e7f5d1b5bde0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.215298 Jun 21 10:01:57.642742 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 231/417] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:57 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:57.750550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1808739080"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:57.751177 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:57.758084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:57.758528 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:57.759302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:57.759742 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:57.885305 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.network.security_group_api [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Adding security group cc75edb9-e487-4fd2-bfde-387b6c7c1260 to port 5e690880-831e-4245-ae93-a349bd151897 Jun 21 10:01:58.281185 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-939805f8-a1af-4dd2-b76e-3f737ddd4b1e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/action" status: 202 len: 0 microversion: 2.1 time: 0.535808 Jun 21 10:01:58.284764 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 187/418] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:01:57 2022] POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:01:58.290778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-e75f8c21-7955-4176-ba59-1af2c0c3f71b req-664191e6-a804-4742-8835-57f2d1f6f7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:01:58.292712 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:58.294106 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:58.300500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:58.301241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:58.302226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:58.302882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:58.305435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e75f8c21-7955-4176-ba59-1af2c0c3f71b req-664191e6-a804-4742-8835-57f2d1f6f7eb service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:58.309541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e75f8c21-7955-4176-ba59-1af2c0c3f71b req-664191e6-a804-4742-8835-57f2d1f6f7eb service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:58.336523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-e75f8c21-7955-4176-ba59-1af2c0c3f71b req-664191e6-a804-4742-8835-57f2d1f6f7eb service nova] Creating event network-changed:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:01:58.345655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-e75f8c21-7955-4176-ba59-1af2c0c3f71b req-664191e6-a804-4742-8835-57f2d1f6f7eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058769 Jun 21 10:01:58.348119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 232/419] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:01:58.526805 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:58.546535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7a1f8e0c-6277-4e1d-b648-905d049da812 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1642 microversion: 2.1 time: 0.248823 Jun 21 10:01:58.560217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 188/420] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:58 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1642 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:01:58.664182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:58.664883 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:58.679113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:58.679663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:58.680609 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:58.681276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:58.984973 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:58.994941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:58.997072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:01:58.998227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-50dce455-0b50-4682-90e0-76dfed92aee0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.340937 Jun 21 10:01:58.998783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 233/421] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:01:58 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:01:59.759487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:59.760031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:59.766950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:59.767408 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:59.774234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:59.774685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:59.800922 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:01:59.881233 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dbc43a31-bf5e-46e0-bc23-e72d75a8a12d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 204 len: 0 microversion: 2.1 time: 0.125234 Jun 21 10:01:59.881800 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 189/422] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:01:59 2022] DELETE /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:01:59.892615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:01:59.893356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:01:59.899740 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:59.900235 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:01:59.901002 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:01:59.901433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:00.017532 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:00.018164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:00.024102 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:00.024558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:00.025334 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:00.025775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:00.029895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:00.038459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:00.046382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b2029029-c92f-4ad2-89c5-9eb938ba744d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1513 microversion: 2.1 time: 0.160356 Jun 21 10:02:00.047090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 234/423] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:01:59 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:00.158729 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:00.167079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:00.168630 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:00.169818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-181da3ef-6045-4027-ba1c-738fa884108d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.156529 Jun 21 10:02:00.170375 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 190/424] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:00 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:02:01.063724 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:01.064426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:01.070909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:01.071357 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:01.072157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:01.072592 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:01.188435 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:01.189260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:01.196227 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:01.196423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:01.197124 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:01.198012 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:01.200946 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:01.209412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7cc13525-b285-48b3-9625-b9a205ba6da6 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1513 microversion: 2.1 time: 0.150010 Jun 21 10:02:01.209979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 235/425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:01 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:01.332599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:01.341217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:01.342719 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:01.343875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7894c191-6d87-4043-a4e7-3ecd55132e05 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.160082 Jun 21 10:02:01.344465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 191/426] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:01 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:02:02.226710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:02.227322 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:02.233288 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:02.233733 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:02.234507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:02.234938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:02.360471 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:02.361776 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:02.362634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:02.368337 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-73c1b924-153b-4c55-ad21-97c3f29e69bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1513 microversion: 2.1 time: 0.145626 Jun 21 10:02:02.368831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:02.368947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 236/427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:02 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:02.369284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:02.370046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:02.370478 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:02.499766 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:02.508327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:02.509825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:02.510971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-56bf99fd-0b31-4006-abdc-0865fb6f7c62 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.152928 Jun 21 10:02:02.511525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 192/428] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:02 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:02:03.385582 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:03.386134 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:03.393337 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:03.393793 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:03.394597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:03.395040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:03.528076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:03.529674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:03.530396 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:03.536345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c5223e15-758a-497e-9bdd-a98038e2b9fd tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1513 microversion: 2.1 time: 0.154561 Jun 21 10:02:03.537101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 237/429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:03 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:03.538667 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:03.539125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:03.539899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:03.540366 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:03.676376 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:03.685465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:03.686955 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:03.688126 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-51a9455a-6719-47b5-8d5c-050088c25975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.163065 Jun 21 10:02:03.688681 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 193/430] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:03 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:04.553271 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:04.553876 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:04.560440 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:04.560950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:04.561734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:04.562166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:04.687818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:04.695587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-78be9cce-ef5b-49ab-89e9-55d1e15d2886 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1513 microversion: 2.1 time: 0.146090 Jun 21 10:02:04.696174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 238/431] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:04 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:04.706585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:04.707300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:04.714032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:04.714488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:04.715263 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:04.715704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:04.860187 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:04.871692 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:04.880599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:04.892489 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-254d3de2-bf3f-4c4a-bd14-68ec5c4e4821 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1749 microversion: 2.20 time: 0.190047 Jun 21 10:02:04.893057 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 194/432] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:04 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:05.318871 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-7c1ab3e3-4d98-41a5-ac34-a566514b3e50 req-86f5cf5a-6068-4d39-9be6-5c280b8b3a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8350f7-d196-4024-aff3-344819dfc6fb", "name": "network-vif-deleted", "tag": "49ea6b43-9094-4864-b575-067d46d75c72"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:05.327432 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-7c1ab3e3-4d98-41a5-ac34-a566514b3e50 req-86f5cf5a-6068-4d39-9be6-5c280b8b3a34 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:05.327863 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-7c1ab3e3-4d98-41a5-ac34-a566514b3e50 req-86f5cf5a-6068-4d39-9be6-5c280b8b3a34 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:05.338225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-7c1ab3e3-4d98-41a5-ac34-a566514b3e50 req-86f5cf5a-6068-4d39-9be6-5c280b8b3a34 service nova] Creating event network-vif-deleted:49ea6b43-9094-4864-b575-067d46d75c72 for instance ea8350f7-d196-4024-aff3-344819dfc6fb on hv-cinder-80660 Jun 21 10:02:05.343124 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-7c1ab3e3-4d98-41a5-ac34-a566514b3e50 req-86f5cf5a-6068-4d39-9be6-5c280b8b3a34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027960 Jun 21 10:02:05.343677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 239/433] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:05.712025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:05.712642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:05.719065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:05.719518 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:05.720317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:05.720755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:05.753948 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:05.754397 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:05.754853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lazy-loading 'fault' on Instance uuid ea8350f7-d196-4024-aff3-344819dfc6fb {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:05.797167 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:05.804676 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cb817c5d-4c52-40e4-866f-21138e401c4c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 200 len: 1308 microversion: 2.1 time: 0.096474 Jun 21 10:02:05.805232 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 195/434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:05 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:05.911597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:05.912324 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:05.918652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:05.919629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:05.920436 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:05.921073 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:06.140364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:06.143906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:06.150284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:06.151772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:06.153029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-637af5f2-cb96-4e2f-9cb4-647291857ecc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.246178 Jun 21 10:02:06.154087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 240/435] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:05 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:06.822092 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:06.822743 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: ea8350f7-d196-4024-aff3-344819dfc6fb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:06.829462 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:06.829914 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:06.830686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:06.831127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:06.844975 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] HTTP exception thrown: Instance ea8350f7-d196-4024-aff3-344819dfc6fb could not be found. Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Request method failure captured: Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb HTTP/1.1 Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZaxzE80aSKWdYAzI7qqfBDSsdsspH_5_lO7o-pQiJIrbNTB9uHwS_Y--NkIR0CJEG_07encdsop-yiDZaIJd1NpGhB-KqIC6jwPlUQ3TJ1LAqWxPxSFg0e1__FiWW7GUTxBzO1weCe1KQis-kKIenRmtrq-xh3tQXi4ymGuVkGXBzw Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 8918c8442bf64ad28ea153a36b194f8a Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1871566194 Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:02:06.846844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8918c8442bf64ad28ea153a36b194f8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8918c8442bf64ad28ea153a36b194f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8918c8442bf64ad28ea153a36b194f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8918c8442bf64ad28ea153a36b194f8a"}]}] Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesSnapshotTestJSON-1871566194 Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 8918c8442bf64ad28ea153a36b194f8a Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1871566194 Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesSnapshotTestJSON-1871566194-project Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: dc1444d1ccf94601a11be7ed6f643798 Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesSnapshotTestJSON-1871566194-project Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance ea8350f7-d196-4024-aff3-344819dfc6fb could not be found. Jun 21 10:02:06.848426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'ea8350f7-d196-4024-aff3-344819dfc6fb'} Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8350f7-d196-4024-aff3-344819dfc6fb could not be found. Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:02:06.849332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8350f7-d196-4024-aff3-344819dfc6fb could not be found. Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8350f7-d196-4024-aff3-344819dfc6fb could not be found. Jun 21 10:02:06.850837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:02:06.852155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Returning 404 to user: Instance ea8350f7-d196-4024-aff3-344819dfc6fb could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:02:06.852155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-70becaba-a1a9-41e3-be19-b11f6f735edb tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb" status: 404 len: 111 microversion: 2.1 time: 0.029979 Jun 21 10:02:06.852155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 196/436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:06 2022] GET /compute/v2.1/servers/ea8350f7-d196-4024-aff3-344819dfc6fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:02:07.177945 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:07.177945 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:07.194747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:07.195568 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:07.196579 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:07.197222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:07.353014 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:07.362256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:07.364244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:07.365548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-85fc07a4-cc51-490c-8ae4-09de2236ba8f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.197244 Jun 21 10:02:07.366332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 241/437] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:07 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:08.386744 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:08.387312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:08.394712 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:08.395853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:08.396703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:08.397153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:08.538539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:08.547928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:08.549483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:08.550659 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6f15b025-17ed-4f90-9240-86eb7c90ea0b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.167922 Jun 21 10:02:08.551205 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 197/438] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:08 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:09.569791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:09.571102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:09.578677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:09.579128 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:09.579902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:09.580358 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:09.749137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:09.758188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:09.759940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:09.761326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-867ab88d-bff7-4ce6-b547-a0cbe72edc99 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.195481 Jun 21 10:02:09.773753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 242/439] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:09 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:10.785839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:10.787610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:10.795811 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:10.796301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:10.797081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:10.797515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:10.930586 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:10.939891 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:10.941417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:10.942573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-880d26fe-bea5-4430-b025-216e5c83ffb2 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.165313 Jun 21 10:02:10.943112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 198/440] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:10 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:11.897441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:02:11.898514 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Tue Jun 21 10:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:02:11.960827 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:11.961428 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:11.968163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:11.968861 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:11.969636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:11.970058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:12.180686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:12.191336 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:12.193519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:12.195107 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9b93e4b1-82a2-4c7f-8bec-ba2ac91aef91 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.238094 Jun 21 10:02:12.195678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 243/441] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:11 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:13.214805 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:13.215417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:13.222905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:13.223636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:13.224533 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:13.224960 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:13.428235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:13.439125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:13.441847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:13.443249 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0224fbf9-9d9d-4d74-a459-acfc9d322114 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.232351 Jun 21 10:02:13.443953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 199/442] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:13 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:14.463093 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:14.464427 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:14.471720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:14.474623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:14.478106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:14.484818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:14.745839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:14.755530 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:14.757340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:14.770067 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-42111cc6-dccd-43c3-b386-257a112aefe1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.311304 Jun 21 10:02:14.771317 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 244/443] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:14 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:15.789705 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:15.790423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:15.793246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:15.798472 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:15.799054 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:15.799927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:15.800484 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:16.021396 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:16.047384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:16.049136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:16.051272 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-84167067-3495-4782-b404-b34c795c26a4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.265491 Jun 21 10:02:16.065953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 200/444] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:15 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:16.866314 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1765764920", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "networks": [{"uuid": "185c9add-805f-4bad-835c-abfdebede942"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:16.939112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] validate_networks() for [('185c9add-805f-4bad-835c-abfdebede942', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:02:17.072786 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:17.073399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:17.083822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:17.084777 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:17.103037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:17.104230 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:17.320462 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:17.339824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:17.342025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:17.344130 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ab829dd2-ccfa-43a5-b10b-8a133c60e87d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.275584 Jun 21 10:02:17.357168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 201/445] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:17 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:17.422292 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:02:17.422765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:02:17.423257 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:02:17.423670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:02:17.424341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:02:17.434031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:17.434455 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:17.435410 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:17.435785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:17.477648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Getting quotas for project 8918c8442bf64ad28ea153a36b194f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:02:17.485545 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Getting quotas for user dc1444d1ccf94601a11be7ed6f643798 and project 8918c8442bf64ad28ea153a36b194f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:02:17.502454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:02:17.506030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:02:17.579335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1ad0101f-9862-42ee-903c-4d64c3cf32ff tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717134 Jun 21 10:02:17.580650 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 245/446] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:02:17.596610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e9b78921-e4d0-43fa-a8eb-7b5c1ca01225 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:17.597810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e9b78921-e4d0-43fa-a8eb-7b5c1ca01225 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:17.679278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9b78921-e4d0-43fa-a8eb-7b5c1ca01225 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:17.686737 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e9b78921-e4d0-43fa-a8eb-7b5c1ca01225 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1219 microversion: 2.1 time: 0.100140 Jun 21 10:02:17.695792 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 202/447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:17 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:18.363568 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:18.364269 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:18.366593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:18.378950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:18.379402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:18.380201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:18.381006 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:18.527109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:18.540580 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:18.542252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:18.543439 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eb0119b7-93d2-4592-9f2c-ea8291d15631 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.184966 Jun 21 10:02:18.544021 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 246/448] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:18 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:18.703629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:18.704438 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:18.711259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:18.711952 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:18.712753 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:18.713209 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:18.800682 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:18.811489 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-42fc09d5-f893-4461-bbcc-617e553170da tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1271 microversion: 2.1 time: 0.112161 Jun 21 10:02:18.822659 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 203/449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:18 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:19.032803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "725f8ec5-75d8-49e2-8217-ffded7306fd2"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:19.033902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:19.043689 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:19.047451 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:19.049393 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:19.054058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:19.510459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-21e3de4f-5e3c-4f0b-bd4b-d2866ada9835 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485526 Jun 21 10:02:19.511794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 247/450] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:02:19 2022] POST /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:19.565123 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:19.565726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:19.573555 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:19.573850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:19.574590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:19.583206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:19.742306 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:19.752666 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:19.757029 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:19.760036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a6134cb5-d5ef-456d-ae28-f90f5e1f0258 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.202019 Jun 21 10:02:19.761127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 204/451] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:19 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:19.831796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:19.832628 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:19.843090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:19.844812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:19.846703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:19.847348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:19.960301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:19.970330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b11ab0ef-ea46-4c0a-8034-0ae7d831a2c3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1277 microversion: 2.1 time: 0.141587 Jun 21 10:02:19.972226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 248/452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:19 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:20.782323 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:20.783788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:20.794402 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:20.800429 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:20.802955 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:20.803631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:20.861759 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-c849241a-5980-4f98-b3b7-7e64025d0d8f req-76328386-df19-4f43-8468-0cf860f91b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eaf513e-bb18-4125-9860-5d255c7cb7d5", "tag": "efeb0d54-f80b-4236-8558-50476f81c98b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:20.876676 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c849241a-5980-4f98-b3b7-7e64025d0d8f req-76328386-df19-4f43-8468-0cf860f91b60 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:20.880211 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c849241a-5980-4f98-b3b7-7e64025d0d8f req-76328386-df19-4f43-8468-0cf860f91b60 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:20.912821 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-c849241a-5980-4f98-b3b7-7e64025d0d8f req-76328386-df19-4f43-8468-0cf860f91b60 service nova] Creating event network-changed:efeb0d54-f80b-4236-8558-50476f81c98b for instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 on hv-cinder-80660 Jun 21 10:02:20.923605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-c849241a-5980-4f98-b3b7-7e64025d0d8f req-76328386-df19-4f43-8468-0cf860f91b60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066786 Jun 21 10:02:20.924793 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 249/453] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:20.990388 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:20.991089 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:20.997971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:20.998575 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:20.999542 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:21.000016 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:21.201900 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:21.218046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:21.220213 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:21.227182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a8dd9c86-550c-4e64-bdb0-59bd3c32dfaa tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.452119 Jun 21 10:02:21.230811 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 205/454] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:20 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:21.294265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:21.303170 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-aa6531ea-dcf4-4e57-b75f-78f698ae9660 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.317748 Jun 21 10:02:21.306227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 250/455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:20 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:22.253365 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:22.254032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:22.260894 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:22.261530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:22.262478 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:22.263059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:22.322125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:22.322841 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:22.334563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:22.339902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:22.341195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:22.344585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:22.453081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:22.462413 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:22.464231 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:22.465682 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fedae81d-6314-40b9-8908-38b786aef44a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.217020 Jun 21 10:02:22.466892 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 206/456] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:22 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:22.638237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:22.648850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-621e7907-0f08-4ea0-9f2a-ca5fc66f991c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.330760 Jun 21 10:02:22.651106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 251/457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:22 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:23.489025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:23.489783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:23.498165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:23.500847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:23.501924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:23.502639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:23.658608 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:23.666983 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:23.667550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:23.668425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:23.668823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:23.670526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e129fa20-db34-4a7e-8936-c072a34f118a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.188817 Jun 21 10:02:23.672613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 207/458] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:23 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:23.676566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:23.677255 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:23.678262 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:23.678783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:23.936048 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:23.944082 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6eef7f7a-1c58-4126-9a86-30ca96fed947 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.280760 Jun 21 10:02:23.945389 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 252/459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:23 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:24.690226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:24.690836 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:24.701113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:24.710223 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:24.711376 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:24.712033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:24.716939 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:24.963596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:24.988190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:24.990405 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:24.992037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4407909c-0e29-4910-ba7a-f6a9affc4163 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.306251 Jun 21 10:02:25.009046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 208/460] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:24 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:25.020340 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:25.020993 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:25.027636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:25.028145 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:25.028924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:25.029366 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:25.078507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3b3b501c-1b7e-4cb2-a8ac-c7d20fb832a3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Action: 'create', calling method: .version_select at 0x7f184abdbee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1958769818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBguEbxu7r1cPY+xV3MXsxlWkiIlnf6bsAiX/UTOWY5+8OySMI+8qfj7BXsGANh1tRf5UMy4yVGs0SLaEO61gk3COt8v67uhLwmMIIZx6Y/SFVfrJXYVmOR3okMeZmEFtg=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:25.101512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-3b3b501c-1b7e-4cb2-a8ac-c7d20fb832a3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for project 95b4310d4b154732b31c773044f56154. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:02:25.106123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-3b3b501c-1b7e-4cb2-a8ac-c7d20fb832a3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for user b51e11f068d948a889871ce53ce29ceb and project 95b4310d4b154732b31c773044f56154. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:02:25.132672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3b3b501c-1b7e-4cb2-a8ac-c7d20fb832a3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.409658 Jun 21 10:02:25.133280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 253/461] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:02:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:25.179902 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:25.188820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-02feece8-864b-458d-9896-16cbf3c0d55f tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.178277 Jun 21 10:02:25.189387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 209/462] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:25 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:26.012200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:26.013137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:26.020533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:26.021154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:26.021739 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:26.022173 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:26.092633 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:26.094378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:26.103583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:26.104063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:26.104845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:26.105407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:26.207369 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:26.217650 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:26.220090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:26.221642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-888bd1fa-d44a-44c6-b450-262f07f5224a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.214414 Jun 21 10:02:26.222349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 254/463] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:26 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:26.227223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:26.228007 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:26.245862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:26.246406 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:26.248176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:26.249617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:26.251733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lazy-loading 'services' on Instance uuid c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:26.395337 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b8e2f54e-87f4-40bd-9c7f-3e08c299adb7 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-volume_attachments/d006b1ff-c233-4436-8939-773b839a6969" status: 202 len: 0 microversion: 2.1 time: 0.312692 Jun 21 10:02:26.398906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 210/464] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:02:26 2022] DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-volume_attachments/d006b1ff-c233-4436-8939-773b839a6969 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:26.429446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:26.439174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bdd95702-4fe0-4ea6-806e-9bf878dbba1a tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.215507 Jun 21 10:02:26.442061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 255/465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:26 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:27.121905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-50575116-8eca-4899-9b9b-636886b2e0aa req-8d30b075-294d-4df4-ab27-a0ca731dd312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaf513e-bb18-4125-9860-5d255c7cb7d5", "name": "network-vif-plugged", "status": "completed", "tag": "efeb0d54-f80b-4236-8558-50476f81c98b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:27.147785 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-50575116-8eca-4899-9b9b-636886b2e0aa req-8d30b075-294d-4df4-ab27-a0ca731dd312 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.148198 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-50575116-8eca-4899-9b9b-636886b2e0aa req-8d30b075-294d-4df4-ab27-a0ca731dd312 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.180789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-50575116-8eca-4899-9b9b-636886b2e0aa req-8d30b075-294d-4df4-ab27-a0ca731dd312 service nova] Creating event network-vif-plugged:efeb0d54-f80b-4236-8558-50476f81c98b for instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 on hv-cinder-80660 Jun 21 10:02:27.185813 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-50575116-8eca-4899-9b9b-636886b2e0aa req-8d30b075-294d-4df4-ab27-a0ca731dd312 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070068 Jun 21 10:02:27.186524 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 211/466] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:27.240035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:27.241350 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:27.249045 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.249575 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:27.250462 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.251041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:27.251911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.252682 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.258542 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.259108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.260028 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.260576 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.291185 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lazy-loading 'flavor' on Instance uuid e1006e00-26c8-474c-b97b-8d599dff1cad {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:27.444952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:27.494081 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:27.509539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:27.511470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:27.515729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dcc53554-f46b-421e-bd8c-f9188acdaf4d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.279825 Jun 21 10:02:27.516866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 256/467] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:27 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:27.521824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:27.522657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:27.529311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.529999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.531824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.532663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.581715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-12912117-1c5f-42a9-9dce-0718f94fdf5e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/action" status: 200 len: 32 microversion: 2.1 time: 0.337457 Jun 21 10:02:27.582786 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 212/468] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:02:27 2022] POST /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 10:02:27.592696 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:27.593695 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:27.604188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.605456 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.606350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:27.606891 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:27.719755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:27.881788 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:27.895136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d3d6a0eb-237b-4a10-9744-fc2335933c3e tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.374236 Jun 21 10:02:27.897038 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 257/469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:27 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:28.146004 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:28.156963 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8a176dbc-72b6-4531-9286-f0a480a2d5b1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.569138 Jun 21 10:02:28.158193 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 213/470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:27 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:28.534807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:28.535625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:28.542233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.542758 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:28.543611 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.544157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:28.564086 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:28.608108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-74c1b9da-1296-4fc7-9814-245019bf618e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:28.616194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74c1b9da-1296-4fc7-9814-245019bf618e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.616653 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74c1b9da-1296-4fc7-9814-245019bf618e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:28.640723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-74c1b9da-1296-4fc7-9814-245019bf618e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Going to try to stop instance {{(pid=117564) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 10:02:28.687948 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-74c1b9da-1296-4fc7-9814-245019bf618e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.086393 Jun 21 10:02:28.689112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 214/471] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:02:28 2022] POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:28.697776 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:28.698480 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:28.705583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.706261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:28.707069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.707510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:28.734968 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:28.748720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:28.750814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:28.756216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3b6abc95-07ea-493f-85c1-b494b6574750 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.225744 Jun 21 10:02:28.756978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 258/472] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:28 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:28.849166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:28.856593 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f62a2c53-1c78-4631-849d-7f4c2731c0d1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.162957 Jun 21 10:02:28.857136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 215/473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:28 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:28.912968 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:28.913788 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:28.921902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.922583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:28.923710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:28.924394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.080551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:29.088107 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-87b2bc98-7f1f-4e73-8a82-91ed1e89ebfc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1319 microversion: 2.1 time: 0.179270 Jun 21 10:02:29.097837 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 259/474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:28 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:29.176355 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:29.177946 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:29.185107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.185712 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.186595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.187173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.336479 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:29.347080 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8f86440b-7773-4c08-90c0-25f6c393a105 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.176024 Jun 21 10:02:29.358311 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 216/475] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:29 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:29.376348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-57012200-3f92-4201-ad4f-1811b5d17dbc req-93fb1a52-015d-43b7-8811-de9713ad1eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "name": "network-vif-plugged", "status": "completed", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:29.384763 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-57012200-3f92-4201-ad4f-1811b5d17dbc req-93fb1a52-015d-43b7-8811-de9713ad1eee service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.385454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-57012200-3f92-4201-ad4f-1811b5d17dbc req-93fb1a52-015d-43b7-8811-de9713ad1eee service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.400997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-57012200-3f92-4201-ad4f-1811b5d17dbc req-93fb1a52-015d-43b7-8811-de9713ad1eee service nova] Creating event network-vif-plugged:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 10:02:29.408286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-57012200-3f92-4201-ad4f-1811b5d17dbc req-93fb1a52-015d-43b7-8811-de9713ad1eee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035790 Jun 21 10:02:29.408968 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 260/476] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:29.774767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:29.775502 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:29.782898 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.783346 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.784217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.784652 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.875939 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:29.877561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:29.885038 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.885776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.886810 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:29.887282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:29.924727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:29.933456 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:29.935112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:29.936406 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d7c22450-9a87-470e-a1a0-51e34ed10711 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.165508 Jun 21 10:02:29.937442 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 217/477] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:29 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:30.023257 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:30.030707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-72675209-db9c-40ec-8252-871694feaadb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.160558 Jun 21 10:02:30.031290 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 261/478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:29 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:30.105405 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:30.106025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:30.112786 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.113493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.114267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.114703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.247064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:30.255267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f78e1cb7-91aa-4108-995e-6f5a3d991adc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1508 microversion: 2.1 time: 0.153733 Jun 21 10:02:30.255823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 218/479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:30 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:30.271303 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ac7daf2-56aa-474f-8785-4b53b7ae1e5b", "device": "/dev/sdb"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:30.272918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:30.278934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.279381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.280252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.280718 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.365597 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:30.366203 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:30.372191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.372638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.373394 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.373835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.503374 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:30.512497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a6875e6e-d54a-4e92-a042-9587db62c086 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.150798 Jun 21 10:02:30.513070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 219/480] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:30 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:30.956183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:30.956849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:30.962223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e10e6c0c-b74a-4031-971a-ee4d94616c80 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "POST /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694758 Jun 21 10:02:30.962814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 262/481] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:02:30 2022] POST /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:30.963184 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.963741 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:30.964552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:30.964994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:31.055454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:31.056170 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:31.064050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:31.065079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:31.065873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:31.066822 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:31.110770 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:31.119929 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:31.121708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:31.122871 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2c207e36-71c0-4d32-b106-8e118879c3da tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.171402 Jun 21 10:02:31.123506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 220/482] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:30 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:02:31.236878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:31.244499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e7243887-08a9-42d5-ac45-60417d8adeb2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.194530 Jun 21 10:02:31.245053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 263/483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:31 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:31.530297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:31.531643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:31.538283 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:31.538743 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:31.539517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:31.539956 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:31.678783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:31.682928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:31.690067 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b943c27e-aa37-4c65-a216-9b9cc4754820 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.164061 Jun 21 10:02:31.696148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 221/484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:31 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:32.140154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:32.140768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:32.147267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:32.147721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:32.148527 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:32.148970 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:32.261615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:32.262644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:32.269393 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:32.269908 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:32.270629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:32.271117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:32.286101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:32.294435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:32.295964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:32.297198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f9842573-3231-430e-95f4-1645eabca9d6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.160990 Jun 21 10:02:32.298378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 264/485] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:32 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:32.405983 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:32.414133 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a7643bdf-aa04-4eeb-9103-8ea7710261f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.157129 Jun 21 10:02:32.414995 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 222/486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:32 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:32.706940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:32.707501 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:32.714002 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:32.714443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:32.715197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:32.715627 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:32.844294 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:32.853442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8f732e1b-a885-4571-9b7a-d887714cf169 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.150853 Jun 21 10:02:32.854205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 265/487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:32 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:33.316701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:33.317308 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:33.323836 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:33.324311 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:33.325063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:33.325498 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:33.430975 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:33.431599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:33.438187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:33.439198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:33.439994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:33.440442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:33.458495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:33.466689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:33.468202 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:33.469351 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b1a13074-402e-4b84-88d3-7e800787cdca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1805 microversion: 2.20 time: 0.157263 Jun 21 10:02:33.469899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 223/488] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:33 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:33.565643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:33.573179 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bde85d3a-d219-4589-89e7-f100706b3d61 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.146322 Jun 21 10:02:33.573680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 266/489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:33 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:33.870508 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:33.871117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:33.877197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:33.877648 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:33.878403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:33.878841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:34.017237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:34.025701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-180f25b8-2181-4973-a094-3cd0fe5acb0d tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.158887 Jun 21 10:02:34.026162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 224/490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:33 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:34.487686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:34.488579 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:34.495612 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:34.496329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:34.497102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:34.497546 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:34.589524 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:34.590129 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:34.596390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:34.596839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:34.597606 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:34.598042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:34.639308 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:34.649261 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:34.650746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:34.651938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7caf9e7d-4b41-4e66-98c4-fb998dca5133 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1792 microversion: 2.20 time: 0.168154 Jun 21 10:02:34.652547 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 267/491] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:02:34 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1792 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:02:34.730158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:34.738361 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9d05ced0-c51c-4593-98d2-b60c89c4f657 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.152394 Jun 21 10:02:34.738947 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 225/492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:34 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:35.042761 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:35.043286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:35.049954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:35.050405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:35.051171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:35.051615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:35.114630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=10 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:35.181838 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:35.190185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2ee8c444-39d7-4d8a-926c-d180b15aa23e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.151435 Jun 21 10:02:35.190779 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 268/493] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:35 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:35.756735 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:35.757356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:35.763908 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:35.764399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:35.765168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:35.765617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:35.898902 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:35.907173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7391d630-ee61-4bed-aec3-b54f1a46be00 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.154219 Jun 21 10:02:35.907738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 226/494] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:35 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:36.206549 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:36.207146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:36.213675 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:36.214125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:36.214889 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:36.215328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:36.341794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:36.349947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-aecbd33c-ad6e-41b0-a4d7-6861c0c5891b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.147154 Jun 21 10:02:36.350555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 269/495] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:36 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:36.924822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:36.925590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:36.932183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:36.932640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:36.933440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:36.933877 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.063389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:37.071601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-da2eac96-a3d6-472a-8f84-e2239fcdb898 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.151181 Jun 21 10:02:37.072188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 227/496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:36 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:37.367853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:37.368486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:37.375073 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.375529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.376476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.376914 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.514518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:37.515819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:37.516353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:37.522665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.522808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f0330767-3e23-4814-be44-82a0e011ea29 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.158667 Jun 21 10:02:37.523122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.523432 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 270/497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:37 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:37.523915 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.524498 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.547817 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d2f67e45-da3d-4fc6-9a51-e330be913680 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035809 Jun 21 10:02:37.549084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 228/498] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:02:37 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:37.559291 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05ad1174-dd7a-4449-b50f-94b1b498e3bb"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:37.560478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:37.566557 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.566999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.567754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.568212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.654212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Invalid volume: volume 05ad1174-dd7a-4449-b50f-94b1b498e3bb is already attached to instances: 8f4f0fd3-df72-4ad2-bf46-da230bb50235 Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/os-volume_attachments HTTP/1.1 Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 74 Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:02:37.656496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {"volumeAttachment": {"volumeId": "05ad1174-dd7a-4449-b50f-94b1b498e3bb"}} Jun 21 10:02:37.658614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Invalid volume: volume 05ad1174-dd7a-4449-b50f-94b1b498e3bb is already attached to instances: 8f4f0fd3-df72-4ad2-bf46-da230bb50235 Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'server_id': '9b2b3d4c-ca98-448e-a982-9d6d673cb24f', 'body': {'volumeAttachment': {'volumeId': '05ad1174-dd7a-4449-b50f-94b1b498e3bb'}}} Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 05ad1174-dd7a-4449-b50f-94b1b498e3bb is already attached to instances: 8f4f0fd3-df72-4ad2-bf46-da230bb50235 Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:37.659408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 05ad1174-dd7a-4449-b50f-94b1b498e3bb is already attached to instances: 8f4f0fd3-df72-4ad2-bf46-da230bb50235 Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:37.660605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 05ad1174-dd7a-4449-b50f-94b1b498e3bb is already attached to instances: 8f4f0fd3-df72-4ad2-bf46-da230bb50235 Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 400 to user: Invalid volume: volume 05ad1174-dd7a-4449-b50f-94b1b498e3bb is already attached to instances: 8f4f0fd3-df72-4ad2-bf46-da230bb50235 {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7b292c7e-a434-4251-8a0d-3981d6a41cf3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102504 Jun 21 10:02:37.661814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 271/499] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:02:37 2022] POST /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 10:02:37.667444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:37.667936 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:37.674238 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.674681 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.675433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.675867 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.699704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:02:37.774881 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-84b3ad40-28ff-4f4c-b124-4a787064b665 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 204 len: 0 microversion: 2.1 time: 0.110947 Jun 21 10:02:37.775444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 229/500] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:02:37 2022] DELETE /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:02:37.784192 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:37.784796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:37.792371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.792895 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.793812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:37.794250 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:37.923280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:37.932842 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c6185600-98c4-4aa3-a41d-9cff381d5691 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1682 microversion: 2.1 time: 0.153117 Jun 21 10:02:37.933412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 272/501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:37 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:38.089246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:38.089854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:38.096399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:38.096849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:38.097618 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:38.098059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:38.243359 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:38.257579 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-63413717-5a5b-4b5c-9dbf-0d28fc73dd60 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.172621 Jun 21 10:02:38.258160 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 230/502] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:38 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:38.538862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:38.539486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:38.546105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:38.546561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:38.547336 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:38.547777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:38.682195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:38.691451 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0de173d4-e97b-4784-8a48-3875bd388b66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.156331 Jun 21 10:02:38.692033 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 273/503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:38 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:38.949500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:38.950099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:38.956093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:38.956540 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:38.957294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:38.957721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.084001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:39.091576 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-361d99ff-8fe7-48b4-9141-a2e115055150 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1682 microversion: 2.1 time: 0.145900 Jun 21 10:02:39.092164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 231/504] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:38 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:39.274068 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:39.274681 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:39.280681 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.281135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.281905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.282351 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.300780 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:39.412881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:39.420375 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ee05d6e9-f46b-4d50-a3ff-873bae49bd57 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.150022 Jun 21 10:02:39.420929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 274/505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:39 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:39.444166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:39.445211 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:39.451657 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.452151 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.452933 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.453366 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.525372 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-62f849ef-d9e8-4c47-bd4d-ed1d4bb9aaae tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/action" status: 202 len: 0 microversion: 2.1 time: 0.085011 Jun 21 10:02:39.525893 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 232/506] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:02:39 2022] POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:39.533908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:39.534548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:39.540701 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.541297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.541932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.542375 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.679902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:39.688266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9eb15ad4-71fc-48ee-a802-e5a09f53b61f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1752 microversion: 2.1 time: 0.158166 Jun 21 10:02:39.689328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 275/507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:39 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:39.709532 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:39.710254 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:39.716558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.717001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.717750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:39.718182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:39.852723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:39.861638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-109c257b-9dd9-42a0-bf1b-c9cb422eab48 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.156318 Jun 21 10:02:39.862219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 233/508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:39 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:40.109159 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:40.109805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:40.116685 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.117137 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.117898 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.118341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.248489 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:40.256563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a116f442-1fa3-41a5-b4f6-ea785ed0edea tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1682 microversion: 2.1 time: 0.151277 Jun 21 10:02:40.257108 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 276/509] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:40 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:40.436927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:40.437470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:40.443804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.444279 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.445048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.445481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.588822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:40.596822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fcad8fda-f0d2-431b-b3fc-0050e415b365 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.163942 Jun 21 10:02:40.597371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 234/510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:40 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:40.706458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:40.707340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:40.713970 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.714408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.715586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.715708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.878684 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:40.879799 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:40.886493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.887126 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.888224 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:40.888764 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:40.968333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:40.977634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8e9fd130-c651-4b28-82e2-17878d5f5066 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1752 microversion: 2.1 time: 0.275668 Jun 21 10:02:40.978195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 277/511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:40 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1752 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:41.277873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:41.278518 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:41.285873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:41.286443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:41.287335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:41.288456 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:41.432645 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:41.441049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ccebf6eb-e3d3-4f13-bf6c-11d35cee28c0 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1682 microversion: 2.1 time: 0.167149 Jun 21 10:02:41.441691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 278/512] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:41 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:41.448851 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:41.459075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-267980ea-344f-45bf-b563-169af48d8552 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.584208 Jun 21 10:02:41.470818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 235/513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:40 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:41.616044 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:41.616868 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:41.624321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:41.624939 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:41.625846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:41.626423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:41.790598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:41.798450 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed92675b-7846-4f7b-abe7-8034190ffd93 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.188501 Jun 21 10:02:41.799109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 279/514] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:41 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:41.994887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:41.995530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:42.002058 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.002504 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.003263 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.003697 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.007798 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:42.292935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-06aee710-aecb-47f7-964a-3f1411d331b9 req-7330229f-deb5-4380-8e08-c9db1ff596bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2b3d4c-ca98-448e-a982-9d6d673cb24f", "name": "network-vif-deleted", "tag": "425ab937-834c-425d-b04e-493460a22a37"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:42.302896 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-06aee710-aecb-47f7-964a-3f1411d331b9 req-7330229f-deb5-4380-8e08-c9db1ff596bb service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.303472 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-06aee710-aecb-47f7-964a-3f1411d331b9 req-7330229f-deb5-4380-8e08-c9db1ff596bb service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.316013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-06aee710-aecb-47f7-964a-3f1411d331b9 req-7330229f-deb5-4380-8e08-c9db1ff596bb service nova] Creating event network-vif-deleted:425ab937-834c-425d-b04e-493460a22a37 for instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f on hv-cinder-80660 Jun 21 10:02:42.321680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-06aee710-aecb-47f7-964a-3f1411d331b9 req-7330229f-deb5-4380-8e08-c9db1ff596bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032412 Jun 21 10:02:42.322270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 280/515] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:42.322426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:42.330997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0807872c-9ae4-4da9-8f7d-2a63fe151e28 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.339953 Jun 21 10:02:42.331559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 236/516] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:41 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:42.460458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:42.461229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:42.467521 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.468119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.469171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.469721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.477974 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:42.478671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:42.485231 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.486478 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.487451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.487956 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.536640 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:42.545399 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bf1bec0c-59ff-4c9a-b9e6-9366c9db6789 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1614 microversion: 2.1 time: 0.089595 Jun 21 10:02:42.546593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 281/517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:42 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:42.642631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:42.651775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e31027c3-64fb-4e4f-a215-ce5b40a2a739 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.177352 Jun 21 10:02:42.652390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 237/518] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:42 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:42.816241 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:42.816852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:42.823345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.823793 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.824676 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:42.825108 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:42.959285 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:42.966902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-533ed758-c213-4ed9-b33e-68728e897eea tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.154932 Jun 21 10:02:42.967442 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 282/519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:42 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:43.349515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:43.350319 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:43.357013 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.357561 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.358434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.358931 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.525997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:43.533967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9d3f8eab-a8e7-4e4a-a186-ed3e1849082e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.189372 Jun 21 10:02:43.534523 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 238/520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:43 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:43.562601 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:43.563208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:43.569172 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.569615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.570363 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.570794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.630734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:43.638267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-30c91713-f3b5-4542-ae79-802e7453e49c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1614 microversion: 2.1 time: 0.079540 Jun 21 10:02:43.638818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 283/521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:43 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1614 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:43.669556 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:43.670170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:43.676404 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.676859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.677619 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.678055 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.828564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:43.838686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-191f71e6-6e0a-48fe-af29-3826334c1912 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.172827 Jun 21 10:02:43.839444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 239/522] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:43 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:43.983790 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:43.984474 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:43.991530 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.991969 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:43.992755 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:43.993184 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.122494 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:44.130076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7ded2d18-cca4-4535-9d49-01a65d0cb454 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.150094 Jun 21 10:02:44.130627 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 284/523] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:43 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:44.550754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:44.551704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:44.558380 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:44.559344 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.560157 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:44.560591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.655685 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:44.656510 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:44.663497 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:44.663950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.664776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:44.665215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.714983 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:44.723531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cecdbeb1-999a-4fe9-8431-567ad17e1361 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.176712 Jun 21 10:02:44.724119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 240/524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:44 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:44.736247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:44.743949 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eabae3ec-1194-4a44-8a56-0e3ae63cf7fe tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1614 microversion: 2.1 time: 0.092104 Jun 21 10:02:44.744523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 285/525] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:44 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:44.855259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:44.855871 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:44.861808 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:44.862259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.863022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:44.863707 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:44.999329 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:45.007835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f9ba59e6-176c-4a72-aa55-ec3ebc3600a3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.156374 Jun 21 10:02:45.008417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 241/526] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:44 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:45.147419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:45.148063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:45.154652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:45.155105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:45.155873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:45.156345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:45.283062 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:45.290512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-edcc4ef8-4736-4490-97ce-817280ca8220 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.147014 Jun 21 10:02:45.291069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 286/527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:45 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:45.740851 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:45.741494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:45.747954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:45.748449 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:45.749215 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:45.749654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:45.761382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:45.762028 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:45.769922 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:45.770378 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:45.771149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:45.771593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:45.831672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:45.839308 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d578fe5e-2fba-4e61-971b-7076d78e5981 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1327 microversion: 2.1 time: 0.081695 Jun 21 10:02:45.839802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 287/528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:45 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1327 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:45.909267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:45.921332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-aa95f273-0b9a-4cc9-b3bf-43a83d947853 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.184425 Jun 21 10:02:45.922101 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 242/529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:45 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:46.024696 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:46.025524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:46.031543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.032031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.032809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.033281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.164423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:46.172365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-52d0e7ea-a6b9-42a3-b0b0-af2beba34729 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.151505 Jun 21 10:02:46.172922 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 288/530] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:46 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:46.307831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:46.308471 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:46.310313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:46.315652 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.316127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.316882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.317310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.444959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:46.452620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-96c14704-f8a6-4e86-ae00-a8f657c4059d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.148596 Jun 21 10:02:46.453173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 243/531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:46 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:46.855921 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:46.856556 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:46.862619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.863068 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.864113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.864552 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.894238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.894687 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.895138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lazy-loading 'fault' on Instance uuid 9b2b3d4c-ca98-448e-a982-9d6d673cb24f {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:46.940541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:46.942754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:46.943496 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:46.947929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0b874dc4-d70b-499d-a951-62d3c7e7dfd2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 200 len: 1332 microversion: 2.1 time: 0.095882 Jun 21 10:02:46.948727 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 289/532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:46 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:46.950807 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.951355 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:46.952325 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:46.952897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.136331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:47.146189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-01d58f82-05b6-46c3-ac1e-bd7a4d631244 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.207411 Jun 21 10:02:47.147058 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 244/533] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:46 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:47.190329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:47.191480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:47.194646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:47.205361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:47.205871 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.206684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:47.207181 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.332917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:47.340831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9bf9bd1c-ed0a-4e3e-bae4-b7b567fd09c3 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.155440 Jun 21 10:02:47.341386 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 290/534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:47 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:47.470781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:47.471341 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:47.477307 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:47.477753 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.478497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:47.478929 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.603639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:47.611063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-de401171-b999-4eef-8cd7-1f6cf804b763 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.144782 Jun 21 10:02:47.611657 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 245/535] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:47 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:47.965422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:47.966036 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:47.972577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:47.973024 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.973784 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:47.974214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:47.988001 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f HTTP/1.1 Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:02:47.989879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:02:47.991595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '9b2b3d4c-ca98-448e-a982-9d6d673cb24f'} Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:02:47.992713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:02:47.994218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:47.995602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:02:47.995602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d49be981-cc0d-45ff-a8d0-c3a2d7dcec8b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 404 len: 111 microversion: 2.1 time: 0.029700 Jun 21 10:02:47.995602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 291/536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:47 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:02:48.000009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c3790081-4af2-471d-be14-d12ccc7d19e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '.version_select at 0x7f184abe3b80>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:48.019079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c3790081-4af2-471d-be14-d12ccc7d19e1 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797065958" status: 202 len: 0 microversion: 2.1 time: 0.022900 Jun 21 10:02:48.019628 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 246/537] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 10:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797065958 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:48.164189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:48.164828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:48.170881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.171332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.172136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.172585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.179548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:48.318507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:48.326764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-404ca0ff-6257-4a28-845b-f171560f416d tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.166648 Jun 21 10:02:48.327832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 292/538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:48 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:48.357899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:48.358623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:48.364915 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.365461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.366288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.366788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.563140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:48.572034 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f640e86d-da3f-49a7-b715-62bdfa661ae0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.218004 Jun 21 10:02:48.572606 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 247/539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:48 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:48.629111 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:48.629867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:48.636141 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.636670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.637514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.638023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.778026 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:48.785216 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:48.785668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2eee48fe-ce38-4e73-af15-df13382431cb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.161422 Jun 21 10:02:48.785784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:48.786405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 293/540] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:48 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:48.791729 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.792222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.792982 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.793419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.870843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lazy-loading 'services' on Instance uuid 8f4f0fd3-df72-4ad2-bf46-da230bb50235 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:48.943065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-04cfb50b-c2d8-46e5-96f0-c73f9966c12c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments/05ad1174-dd7a-4449-b50f-94b1b498e3bb" status: 202 len: 0 microversion: 2.1 time: 0.161625 Jun 21 10:02:48.943635 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 248/541] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:02:48 2022] DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments/05ad1174-dd7a-4449-b50f-94b1b498e3bb => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:02:48.951817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:48.952824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:48.958771 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.959217 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.959997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:48.960438 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:48.989197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-667e6ce8-deba-475f-8762-990154c0f7be tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Jun 21 10:02:48.989721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 294/542] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:02:48 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:49.345640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:49.346330 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:49.352809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:49.353196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:49.353947 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:49.354375 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:49.497888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:49.505954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1d5d5107-4d61-4d68-ab45-db6ad621aa00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.165406 Jun 21 10:02:49.506516 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 249/543] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:49 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:49.589522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:49.590128 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:49.597196 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:49.597639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:49.598395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:49.598828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:49.724742 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:49.732632 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-44f41fdb-0d38-4bb7-b0db-39ee73c1b73f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.146911 Jun 21 10:02:49.733187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 295/544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:49 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:49.802110 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:49.802721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:49.808694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:49.809148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:49.809910 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:49.810464 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:49.940550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:49.948221 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-15d789f7-1cee-46d4-93ff-d7252b302f5b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1677 microversion: 2.1 time: 0.150094 Jun 21 10:02:49.948773 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 250/545] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:49 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:50.000742 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:50.002246 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:50.008272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.008720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.009514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.009966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.038355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-760fbfaa-9016-4a22-9e93-24107941d9da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Jun 21 10:02:50.038913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 296/546] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:02:49 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:02:50.522550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:50.523159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:50.529788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.530297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.531161 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.531604 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.672388 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:50.681022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e2c47413-8c16-4902-bfbe-0b003f5bad9e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.162294 Jun 21 10:02:50.683265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 251/547] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:50 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:50.749361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:50.749998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:50.757162 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.757610 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.758370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.758805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.887347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:50.895343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-363e4a44-a99a-4727-b86b-feaf8d9c200b tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.149836 Jun 21 10:02:50.895900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 297/548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:50 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:50.965257 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:50.965868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:50.972357 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.972800 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:50.973553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:50.973985 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.050056 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:51.051008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:51.057022 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.057472 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.058240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.058678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.087007 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a8dc97a4-9644-4e83-94ab-60436f0c28d9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041285 Jun 21 10:02:51.087661 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 298/549] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:02:51 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:51.104676 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:51.112881 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-de79e163-e169-445c-a1b9-669894aaee8c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1654 microversion: 2.1 time: 0.151465 Jun 21 10:02:51.113685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 252/550] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:50 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:51.129251 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d9c0b06f-9f3a-4a12-ba05-353a43421076 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:51.135220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d9c0b06f-9f3a-4a12-ba05-353a43421076 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.135670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d9c0b06f-9f3a-4a12-ba05-353a43421076 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.194025 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d9c0b06f-9f3a-4a12-ba05-353a43421076 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Going to try to start instance {{(pid=117563) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 10:02:51.238053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d9c0b06f-9f3a-4a12-ba05-353a43421076 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.112576 Jun 21 10:02:51.239050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 299/551] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:02:51 2022] POST /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:51.247190 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:51.247803 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:51.254749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.255257 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.256050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.256487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.261659 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:51.395543 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:51.403063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-21fe7684-2991-43e7-aa2d-a431bbb04bba tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1663 microversion: 2.1 time: 0.160062 Jun 21 10:02:51.403611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 253/552] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:51 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:51.699213 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:51.699908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:51.706688 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.707135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.707907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.708376 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.848739 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:51.857330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-edd4ed93-7a6f-4488-a1ac-c6cc1f026f12 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.162201 Jun 21 10:02:51.858065 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 300/553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:51 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:51.912277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:51.912889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:51.919515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.919963 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:51.920788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:51.921299 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.021415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1202683210", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1958769818", "security_groups": [{"name": "tempest-secgroup-smoke-1519349506"}], "block_device_mapping_v2": [{"uuid": "c490195c-ee76-40e0-bf11-f049a91fb8ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb4c5df0-05d0-4ec2-aa30-ec9c2dbcfbdd"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:52.053331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:52.061495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-85e11954-bda3-4705-ac6a-755a4d2082ca tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.152954 Jun 21 10:02:52.062139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 254/554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:51 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:52.098866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:52.102349 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:52.108697 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.109386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.110914 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.111466 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.142522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] validate_networks() for [('eb4c5df0-05d0-4ec2-aa30-ec9c2dbcfbdd', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:02:52.144345 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b68cadfd-2b20-4d39-b8d5-c440cbb114b6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Jun 21 10:02:52.144994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 255/555] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:02:52 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:52.420488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:52.421141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:52.428239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.428788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.429720 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.430220 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.564981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:52.573035 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-17a4a726-f48b-480b-882b-41ee0dfd473c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1663 microversion: 2.1 time: 0.156578 Jun 21 10:02:52.573599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 256/556] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:52 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:52.732423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:02:52.732875 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:02:52.733382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:02:52.733913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:02:52.734403 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:02:52.744243 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.744694 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.745524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.745963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.762702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for project 95b4310d4b154732b31c773044f56154. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:02:52.767180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for user b51e11f068d948a889871ce53ce29ceb and project 95b4310d4b154732b31c773044f56154. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:02:52.822120 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:02:52.824241 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c490195c-ee76-40e0-bf11-f049a91fb8ad',volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:02:52.874670 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:52.875321 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:52.881600 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.882048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.882814 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:52.883251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:52.953176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dc5b0ab0-f4d8-4e03-b994-eea541a2546d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.935513 Jun 21 10:02:52.959287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 301/557] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:02:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:02:52.964201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c5d78ffa-a405-43e5-8a32-1c4cf6bb52d9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:52.964812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c5d78ffa-a405-43e5-8a32-1c4cf6bb52d9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:53.021499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c5d78ffa-a405-43e5-8a32-1c4cf6bb52d9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:53.029538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c5d78ffa-a405-43e5-8a32-1c4cf6bb52d9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1095 microversion: 2.1 time: 0.069009 Jun 21 10:02:53.030265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 302/558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:52 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:53.052346 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:53.060492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9aae4bfb-cf52-45c1-bef9-4e0c6ac85f59 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.189701 Jun 21 10:02:53.061078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 257/559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:52 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:53.078493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:53.100370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:53.110037 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.110530 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.111306 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.111912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.157760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:53.158905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:53.167876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.168594 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.169726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.170316 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.218493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1116e78b-ed8c-4f00-9d9b-f704e27328fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065776 Jun 21 10:02:53.219852 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 258/560] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:02:53 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 10:02:53.271751 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:53.283923 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-29704cbf-09dc-4b56-9a30-62f1f22eb30e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.208366 Jun 21 10:02:53.284932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 303/561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:53 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:53.286019 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:53.286520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:53.292970 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.293622 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.294564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.295155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.321525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:02:53.408378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e5b37c76-92e3-4b30-b919-56fbaf9a79a9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 204 len: 0 microversion: 2.1 time: 0.126095 Jun 21 10:02:53.413353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 259/562] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:02:53 2022] DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:02:53.429935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:53.430875 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:53.440226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.441902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.443715 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.444368 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.577949 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:53.585747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8002db1a-689d-48f2-91ef-329e6566e2f9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1680 microversion: 2.1 time: 0.169189 Jun 21 10:02:53.586339 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 304/563] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:53 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:53.590252 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:53.590956 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:53.597132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.597582 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.598348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:53.598784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:53.733611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:53.743099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1bf6aa33-2f84-4d4e-a5aa-2b0967d333c9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1663 microversion: 2.1 time: 0.157174 Jun 21 10:02:53.743647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 260/564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:53 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:54.046828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:54.047461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:54.054629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.055076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.055833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.056299 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.078087 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:54.078715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:54.085309 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.085771 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.086547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.087149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.116498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:54.123991 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dee55cb0-0a86-4c03-96d2-9916531d6094 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1145 microversion: 2.1 time: 0.081022 Jun 21 10:02:54.124577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 305/565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:54 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:54.229623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:54.237793 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ed82d561-7ec8-44dc-bb41-068d47740a5f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.163474 Jun 21 10:02:54.238625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 261/566] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:54 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:54.300807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:54.301356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:54.307335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.307792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.308594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.309037 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.437293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:54.445577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2043efc9-85c6-4b69-a6d9-8e8c36ebad63 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.148539 Jun 21 10:02:54.454740 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 306/567] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:54 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:54.548138 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:54.548637 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:54.554704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.555097 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.555884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.556343 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.602598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:54.603205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:54.609182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.609637 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.610528 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.610844 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.636069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lazy-loading 'services' on Instance uuid 7eaf513e-bb18-4125-9860-5d255c7cb7d5 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:54.711351 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-06fcfbc5-e763-48d5-81a4-f92b35e98c21 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5/os-volume_attachments/1ac7daf2-56aa-474f-8785-4b53b7ae1e5b" status: 202 len: 0 microversion: 2.1 time: 0.166961 Jun 21 10:02:54.712048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 262/568] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:02:54 2022] DELETE /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5/os-volume_attachments/1ac7daf2-56aa-474f-8785-4b53b7ae1e5b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:54.742637 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:54.750379 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a8dc7464-1f09-47ae-88ea-fec97517490d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1680 microversion: 2.1 time: 0.151669 Jun 21 10:02:54.751510 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 307/569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:54 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:54.761045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:54.761775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:54.768599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.769050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.769818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:54.770259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:54.899000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:54.906540 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b89b61ba-b6aa-4b71-b0a7-12c187c23c26 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1663 microversion: 2.1 time: 0.149830 Jun 21 10:02:54.907178 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 263/570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:54 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:55.140254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:55.140907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:55.147429 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.147884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.148711 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.149150 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.210755 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:55.218102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-520bd098-6688-4b3f-81f2-2e984e52769d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1145 microversion: 2.1 time: 0.081714 Jun 21 10:02:55.218658 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 308/571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:55 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:55.255022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:55.255638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:55.262123 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.262580 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.263348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.263795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.463734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:55.464478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:55.471860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.472363 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.473133 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.473796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.495654 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:55.611816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:55.620605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9e1e7dc2-2b1e-44ad-8096-3c346fac0c75 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1733 microversion: 2.1 time: 0.161027 Jun 21 10:02:55.621276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 309/572] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:55 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:55.693396 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:55.701564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f0566a6e-f1f1-4d33-9c00-ffb833c2c1f0 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.450974 Jun 21 10:02:55.702121 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 264/573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:55 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:55.768437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:55.769183 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:55.775364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.775815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.776640 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.777072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.902571 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:55.910770 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e68bdc68-dd70-4e69-8dbf-3565d7f36279 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1680 microversion: 2.1 time: 0.146635 Jun 21 10:02:55.911330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 310/574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:55 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:55.924203 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:55.924840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:55.931003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.931452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:55.932243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:55.932719 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.069526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:56.076899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1349463e-7fc7-4408-aefb-ff9bc326c76e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1663 microversion: 2.1 time: 0.156704 Jun 21 10:02:56.077438 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 265/575] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:55 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:56.234478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:56.235081 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:56.242480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.242947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.243757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.244557 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.315133 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:56.323315 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f838ed0d-4026-4fab-8d56-b7df446e0c18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1193 microversion: 2.1 time: 0.092558 Jun 21 10:02:56.323918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 311/576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:56 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:56.637553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:56.638119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:56.644885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.645569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.646350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.646789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.718634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:56.719245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:56.725600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.726048 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.726815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.727252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.844106 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:56.858725 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-14a8f2eb-b5d6-4fb4-a79f-c6d01fdc03f0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1713 microversion: 2.1 time: 0.224899 Jun 21 10:02:56.859946 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 266/577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:56 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1713 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:56.872200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:56.881749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-58cc9b6e-1b4c-477d-ad89-cf899a01dcce tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.166938 Jun 21 10:02:56.882746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 312/578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:56 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:56.929425 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:56.930217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:56.937107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.937738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.939137 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.939589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.959048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:56.981349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:56.981989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:56.989028 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.989595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:56.990465 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:56.990981 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.039633 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:57.049245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ac3219d7-02dd-4401-ac6a-ed3fe8232412 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1612 microversion: 2.1 time: 0.124343 Jun 21 10:02:57.050755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 267/579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:56 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1612 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:57.073413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] HTTP exception thrown: Cannot 'detach_volume' instance e1006e00-26c8-474c-b97b-8d599dff1cad while it is in vm_state rescued Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Request method failure captured: Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments/725f8ec5-75d8-49e2-8217-ffded7306fd2 HTTP/1.1 Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZdNDs9Ko7zlYJF7H_bJbHJTVIxnR8iGyhh1iKzgo9tfzm7Svxw-WB014SREFGIM7P_lLu6Ghf31048vHTUBRrYMMQy18C_ZxTbkgL6HgyCBvJyUJ0oOzic6vkfhxAjsVX79jz9W-PUH4Kfyf6NYfDz6HMYI4uevPVz6pwxH6_pbdY Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:02:57.075122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a80df511c544924a5708de2513bbc42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a80df511c544924a5708de2513bbc42"}]}] Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 7e98533664dd4bf6b90e471fc42ba41f Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:02:57.076585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Cannot 'detach_volume' instance e1006e00-26c8-474c-b97b-8d599dff1cad while it is in vm_state rescued Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'server_id': 'e1006e00-26c8-474c-b97b-8d599dff1cad', 'id': '725f8ec5-75d8-49e2-8217-ffded7306fd2'} Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1006e00-26c8-474c-b97b-8d599dff1cad in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:02:57.077237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e1006e00-26c8-474c-b97b-8d599dff1cad while it is in vm_state rescued Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e1006e00-26c8-474c-b97b-8d599dff1cad while it is in vm_state rescued Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:02:57.078491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Returning 409 to user: Cannot 'detach_volume' instance e1006e00-26c8-474c-b97b-8d599dff1cad while it is in vm_state rescued {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:02:57.080259 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fc418a87-7d10-4175-8fba-8db2f689646e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments/725f8ec5-75d8-49e2-8217-ffded7306fd2" status: 409 len: 152 microversion: 2.1 time: 0.107237 Jun 21 10:02:57.080259 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 313/580] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:02:56 2022] DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments/725f8ec5-75d8-49e2-8217-ffded7306fd2 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 10:02:57.086468 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:57.087247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:57.093389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.094116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.095195 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.095819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.097595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:57.098226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:57.104640 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.105298 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.106083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.106523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.168765 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6bd21ef1-3dbf-497d-a0cb-eb4a2e95c62c tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "POST /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/action" status: 202 len: 0 microversion: 2.1 time: 0.085813 Jun 21 10:02:57.169945 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 268/581] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:02:57 2022] POST /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:02:57.178446 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:57.179694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:57.185295 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.185749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.186522 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.186962 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.246649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:57.254812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f725ed2a-a7a9-4e6b-addf-2a3967520d88 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1663 microversion: 2.1 time: 0.162272 Jun 21 10:02:57.255648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 314/582] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:57 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:57.339332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-03291ccc-5cb9-43c0-8997-7740a4bb285e req-b06a1403-b47a-45d1-ad94-0948d9f9b6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4f0fd3-df72-4ad2-bf46-da230bb50235", "name": "network-vif-deleted", "tag": "aad0de81-1d91-47a9-b5f2-23512c106d78"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:02:57.350242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-03291ccc-5cb9-43c0-8997-7740a4bb285e req-b06a1403-b47a-45d1-ad94-0948d9f9b6a3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.350895 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-03291ccc-5cb9-43c0-8997-7740a4bb285e req-b06a1403-b47a-45d1-ad94-0948d9f9b6a3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.369125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-03291ccc-5cb9-43c0-8997-7740a4bb285e req-b06a1403-b47a-45d1-ad94-0948d9f9b6a3 service nova] Creating event network-vif-deleted:aad0de81-1d91-47a9-b5f2-23512c106d78 for instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 on hv-cinder-80660 Jun 21 10:02:57.374689 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-03291ccc-5cb9-43c0-8997-7740a4bb285e req-b06a1403-b47a-45d1-ad94-0948d9f9b6a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040080 Jun 21 10:02:57.375524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 315/583] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:02:57.381136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:57.382061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:57.389531 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.390169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.391123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.392327 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.393482 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:57.404152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-75672c0d-bba1-46f9-b393-607e69bb3cf9 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.229612 Jun 21 10:02:57.408661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 269/584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:57 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:57.472623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:57.480850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eda6d41f-15c2-4583-8531-814d872f4925 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1193 microversion: 2.1 time: 0.103718 Jun 21 10:02:57.491256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 316/585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:57 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:57.898721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:57.899571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:57.907843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.908348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:57.909129 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:57.909576 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.064520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:58.067228 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:58.067869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:58.072807 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7cb4c096-751e-4f06-b8a0-73c93279cbc6 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1757 microversion: 2.1 time: 0.177843 Jun 21 10:02:58.082665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 270/586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:57 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:58.082856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.082856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.082856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.082856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.138538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:58.146209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4198e9be-cd33-474b-bb8c-c55d5b86f3dd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1325 microversion: 2.1 time: 0.083323 Jun 21 10:02:58.146766 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 317/587] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:58 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1325 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:58.272203 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:58.272738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:58.278750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.279201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.279967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.280425 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.417201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:58.425000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:58.425634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:58.425740 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-77aef36e-a085-43d6-a77c-26dff0b67416 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1667 microversion: 2.1 time: 0.157540 Jun 21 10:02:58.426276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 271/588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:58 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:58.432222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.432667 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.433426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.433861 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.498132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:58.498740 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:58.504817 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.505267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.506031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:58.506468 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:58.561935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:58.566579 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:58.570067 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-08bfb29f-cb8a-46fb-9888-af44703eeeaf tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.149467 Jun 21 10:02:58.570629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 318/589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:58 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:58.573873 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-403cd666-9d0c-49ef-8f16-eee791e75167 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1193 microversion: 2.1 time: 0.079693 Jun 21 10:02:58.574437 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 272/590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:58 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:59.090216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:59.090827 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:59.098416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.098868 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.099807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.100305 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.163136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:59.163689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:59.170451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.170884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.171655 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.172135 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.205677 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.206132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.206587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lazy-loading 'fault' on Instance uuid 8f4f0fd3-df72-4ad2-bf46-da230bb50235 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:02:59.246303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:59.247026 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:59.254283 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7ad4ebb7-468d-4758-bad2-e3ccb4f3a568 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 200 len: 1330 microversion: 2.1 time: 0.095159 Jun 21 10:02:59.254851 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 273/591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:59 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:02:59.255396 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-361b4a52-8e8e-4a06-a361-3c1e64e9c390 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1760 microversion: 2.1 time: 0.169223 Jun 21 10:02:59.255940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 319/592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:59 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:59.587675 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:59.588348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:59.590167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:02:59.591058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:02:59.596165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.596624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.597394 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.598237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.599184 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.599746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.600684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:02:59.601363 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:02:59.668260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:59.676642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d5983754-00e3-440f-97f9-dc94b979cfb7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1201 microversion: 2.1 time: 0.090463 Jun 21 10:02:59.677200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 320/593] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:59 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:02:59.800979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:02:59.809244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2146d54e-90bb-4ea0-92c4-7c38807f38a8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.226355 Jun 21 10:02:59.809930 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 274/594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:02:59 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:00.272070 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:00.272708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:00.279220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:00.279668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:00.280469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:00.280901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:00.295637 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 HTTP/1.1 Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:03:00.297707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:03:00.299602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '8f4f0fd3-df72-4ad2-bf46-da230bb50235'} Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:03:00.300598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:03:00.301984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:00.303156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:03:00.303156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-41761420-ab40-4dd0-9e2f-8f6a765dc961 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 404 len: 111 microversion: 2.1 time: 0.032937 Jun 21 10:03:00.303156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 321/595] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:00 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:03:00.310849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-77452f5d-f1ee-4e72-99cd-e058ded9fb1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '.version_select at 0x7f184ad1ca60>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:00.333193 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-77452f5d-f1ee-4e72-99cd-e058ded9fb1f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-155728800" status: 202 len: 0 microversion: 2.1 time: 0.026035 Jun 21 10:03:00.334229 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 275/596] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 10:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-155728800 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:03:00.693201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:00.693887 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:00.701331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:00.701947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:00.702876 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:00.703466 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:00.784846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:00.792967 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d4d47d09-67fa-4fbd-90a9-28cf6d66b663 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1211 microversion: 2.1 time: 0.103753 Jun 21 10:03:00.793985 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 322/597] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:00 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:00.827239 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:00.828001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:00.835005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:00.835547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:00.836541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:00.837290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:01.046260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:01.053566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-35b4f08c-05a7-4b30-828a-ed1cb89165e3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: .version_select at 0x7f184aabe3a0>, body: {"keypair": {"name": "tempest-keypair-1920405297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIikgoI8Q6Q8WdyDtKNIkHPNa6n87jGV6OSf+p631L4ualN+Vz+w5fGq3M6PX/Nj0f43yLgO/fgWqmfX3/pbM7FUhFBQ+7jTjfZGJfQw8HB8MGlBBfN2hk0hioho4A7oDQ=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:01.055205 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-342bf02f-d248-4674-855e-e9e598e302a6 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.232406 Jun 21 10:03:01.056191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 276/598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:00 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:01.068633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-35b4f08c-05a7-4b30-828a-ed1cb89165e3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:03:01.072411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-35b4f08c-05a7-4b30-828a-ed1cb89165e3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:03:01.098240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-35b4f08c-05a7-4b30-828a-ed1cb89165e3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048512 Jun 21 10:03:01.099003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 323/599] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:01.181088 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:01.181584 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:01.188056 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:01.189467 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:01.190453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:01.190900 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:01.221234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:03:01.315106 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-01441060-5fc6-4708-bd36-be5249f11551 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 204 len: 0 microversion: 2.1 time: 0.137407 Jun 21 10:03:01.319063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 277/600] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:03:01 2022] DELETE /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:03:01.326852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:01.327671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:01.337188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:01.337704 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:01.338617 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:01.339171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:01.480996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:01.490038 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5ee5a5f7-66ab-4695-89fa-7f310eaf56e3 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1514 microversion: 2.1 time: 0.169246 Jun 21 10:03:01.490757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 324/601] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:01 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:01.810540 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:01.811245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:01.817750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:01.818204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:01.818981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:01.819422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:02.003312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:02.011514 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-95256a13-0f87-4ebc-9ccc-79541edce747 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1279 microversion: 2.1 time: 0.205199 Jun 21 10:03:02.012081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 278/602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:01 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:02.072455 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:02.073066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:02.079050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:02.080061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:02.080826 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:02.081261 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:02.218223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:02.226359 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-852e94e4-4910-412c-ad58-a86e2a211278 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.157952 Jun 21 10:03:02.226929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 325/603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:02 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:02.507067 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:02.507685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:02.513766 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:02.514220 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:02.514990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:02.515458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:02.575839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2046171432", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c994f52e-02e2-4742-8c3a-a41ee59b94bd"}], "security_groups": [{"name": "tempest-securitygroup--336751295"}], "key_name": "tempest-keypair-1920405297", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:02.582623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:02.648675 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:02.657633 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-881c1c85-d00f-49ba-a362-5b5da3a8f1bf tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1514 microversion: 2.1 time: 0.154335 Jun 21 10:03:02.658370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 279/604] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:02 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:02.682327 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] validate_networks() for [('c994f52e-02e2-4742-8c3a-a41ee59b94bd', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:03:02.753631 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:03.028824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:03.029474 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:03.036935 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.037378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.038327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.038792 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.057034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:03:03.058019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:03:03.058019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:03:03.058452 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:03:03.058848 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:03:03.068248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.068698 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.069650 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.070092 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.088504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:03:03.093950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:03:03.107816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:03:03.110138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:03:03.161318 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a4cde0d1-302b-4ddf-bb24-506c72ffa77d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589639 Jun 21 10:03:03.162247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 326/605] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:03:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:03:03.171820 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-99234fbc-02e4-4ce8-8e1d-38ca15b4bd17 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:03.172540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-99234fbc-02e4-4ce8-8e1d-38ca15b4bd17 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:03.227062 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-99234fbc-02e4-4ce8-8e1d-38ca15b4bd17 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:03.233973 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-99234fbc-02e4-4ce8-8e1d-38ca15b4bd17 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1242 microversion: 2.1 time: 0.065789 Jun 21 10:03:03.234671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 327/606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:03 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:03.244443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:03.245170 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:03.253115 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.253456 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.254302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.254812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.301519 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:03.316994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ae22caf8-7abe-461f-819f-7a88fdcdbcdb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1279 microversion: 2.1 time: 0.292119 Jun 21 10:03:03.317568 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 280/607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:03 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1279 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:03.418413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:03.428305 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f57f2a38-c755-4507-93b3-9ff842668a54 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.187497 Jun 21 10:03:03.429000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 328/608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:03 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:03.675386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:03.676056 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:03.682138 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.682588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.683356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.683795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.730608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-341aca8d-ecdd-4aaa-ac1b-71dc9317b945 req-16c3c1b0-672d-460e-8d53-3a19723263ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a76d1a-f9e8-459f-92ad-02a806ab20ab", "tag": "cc0f7d8e-9dc6-4782-8fb4-190065a75b9f"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:03.740096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-341aca8d-ecdd-4aaa-ac1b-71dc9317b945 req-16c3c1b0-672d-460e-8d53-3a19723263ca service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:03.740538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-341aca8d-ecdd-4aaa-ac1b-71dc9317b945 req-16c3c1b0-672d-460e-8d53-3a19723263ca service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:03.757587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-341aca8d-ecdd-4aaa-ac1b-71dc9317b945 req-16c3c1b0-672d-460e-8d53-3a19723263ca service nova] Creating event network-changed:cc0f7d8e-9dc6-4782-8fb4-190065a75b9f for instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab on hv-cinder-80660 Jun 21 10:03:03.764659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-341aca8d-ecdd-4aaa-ac1b-71dc9317b945 req-16c3c1b0-672d-460e-8d53-3a19723263ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037549 Jun 21 10:03:03.765323 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 329/609] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:03.855616 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:03.864170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a43f0f98-a12b-4244-974b-5b1b0bc35fce tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1514 microversion: 2.1 time: 0.193139 Jun 21 10:03:03.864746 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 281/610] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:03 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:04.252768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:04.253411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:04.260166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.260619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.261373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.261805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.321428 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:04.324873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:04.330419 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-30c3dbf9-5152-4c5d-b33a-31a647fb8beb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1246 microversion: 2.1 time: 0.082477 Jun 21 10:03:04.330967 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 330/611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:04 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:04.334212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:04.334832 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:04.340990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.341443 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.342203 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.342643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.346668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:04.446201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:04.446960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:04.455551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.456902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.457688 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.458131 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.478030 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:04.486132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-62d0f693-e07f-420a-a914-7919e498bf0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1279 microversion: 2.1 time: 0.155685 Jun 21 10:03:04.486762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 282/612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:04 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:04.614136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:04.622022 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d5fe150d-100b-4e6e-aa07-ee5d3e329317 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1721 microversion: 2.1 time: 0.180106 Jun 21 10:03:04.622572 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 331/613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:04 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:04.881905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:04.882479 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:04.888714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.889169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:04.889933 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:04.890373 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.025481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:05.033525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-98628075-2a90-4590-bac5-17c2d2b9e1dc tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1514 microversion: 2.1 time: 0.155907 Jun 21 10:03:05.034082 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 283/614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:04 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:05.346849 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:05.347461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:05.353925 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.354371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.355131 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.355567 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.417485 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:05.425254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ee9abe2a-60f2-4241-80eb-7962784db71d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1238 microversion: 2.1 time: 0.082324 Jun 21 10:03:05.425806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 332/615] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:05 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:05.504500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:05.505112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:05.507421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:05.512605 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.513056 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.513816 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.514253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.640241 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:05.641094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:05.647562 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.648297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.649075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.649680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.777128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:05.778211 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:05.785107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-24144190-032d-4f48-adf5-067de6e678c5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.285110 Jun 21 10:03:05.785661 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 284/616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:05 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:05.786656 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ae43d872-3bbd-42cd-8f35-d26c5f4f8766 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1727 microversion: 2.1 time: 0.150807 Jun 21 10:03:05.787195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 333/617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:05 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:05.802710 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:05.803297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:05.809142 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.809597 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.810357 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:05.810796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:05.889709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3d5d307d-7c3a-4389-908e-983a808f0e20 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090664 Jun 21 10:03:05.890466 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 285/618] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 10:03:05 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:06.050554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:06.051195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:06.057301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:06.057747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:06.058583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:06.059099 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:06.301122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:06.308934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-008222da-4baa-4ba3-b50d-8e05077f301c tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1514 microversion: 2.1 time: 0.262233 Jun 21 10:03:06.309505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 334/619] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:06 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:06.442285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:06.442895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:06.448953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:06.449407 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:06.450179 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:06.450619 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:06.559460 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:06.567046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-17c7512c-28c2-441e-a918-0081a611bb5f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1300 microversion: 2.1 time: 0.129392 Jun 21 10:03:06.567638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 286/620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:06 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:06.804495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:06.805402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:06.811799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:06.812498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:06.813354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:06.813856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.025454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:07.033809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2f83cfaa-e9b6-42ed-98b6-f95b49e68e4d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.233542 Jun 21 10:03:07.034597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 335/621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:06 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:07.115196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0d008cb1-b7aa-42dc-a22b-c787ca416534 req-b997b070-cbc3-432c-a70e-1ff13d237436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaf513e-bb18-4125-9860-5d255c7cb7d5", "name": "network-vif-deleted", "tag": "efeb0d54-f80b-4236-8558-50476f81c98b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:07.129656 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d008cb1-b7aa-42dc-a22b-c787ca416534 req-b997b070-cbc3-432c-a70e-1ff13d237436 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:07.132552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d008cb1-b7aa-42dc-a22b-c787ca416534 req-b997b070-cbc3-432c-a70e-1ff13d237436 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.145529 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0d008cb1-b7aa-42dc-a22b-c787ca416534 req-b997b070-cbc3-432c-a70e-1ff13d237436 service nova] Creating event network-vif-deleted:efeb0d54-f80b-4236-8558-50476f81c98b for instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 on hv-cinder-80660 Jun 21 10:03:07.151929 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0d008cb1-b7aa-42dc-a22b-c787ca416534 req-b997b070-cbc3-432c-a70e-1ff13d237436 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041069 Jun 21 10:03:07.153276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 287/622] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:07.326410 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:07.327193 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:07.334249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:07.334844 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.335729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:07.336290 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.374074 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:07.374940 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.375599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lazy-loading 'fault' on Instance uuid 7eaf513e-bb18-4125-9860-5d255c7cb7d5 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:03:07.427024 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1444d1ccf94601a11be7ed6f643798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8918c8442bf64ad28ea153a36b194f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:07.435321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d3b04dd0-cbb7-40e0-82cb-74661178eb73 tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 200 len: 1309 microversion: 2.1 time: 0.112666 Jun 21 10:03:07.435906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 336/623] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:07 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:07.585945 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:07.586643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:07.598121 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:07.598569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.599659 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:07.600125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:07.899075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:07.916822 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-72629a7a-caed-4c92-9059-f8f80660f5de tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.335332 Jun 21 10:03:07.928350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 288/624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:07 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:08.052316 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:08.053046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:08.061936 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.062726 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:08.065132 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.065816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:08.287878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:08.300671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5e64229b-eddb-49cc-945a-bcdfeedd355d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.252844 Jun 21 10:03:08.301293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 337/625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:08 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:08.354544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-d6cde1bd-797f-42dc-ab86-de6065ed7b5f req-17cc6540-6272-4aab-93b9-74cfbb2c1eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305651e2-488f-4fed-a8d9-2997709c96ea", "tag": "edef25d3-094d-46dc-a85b-388645403cbd"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:08.365558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-d6cde1bd-797f-42dc-ab86-de6065ed7b5f req-17cc6540-6272-4aab-93b9-74cfbb2c1eb2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.366235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-d6cde1bd-797f-42dc-ab86-de6065ed7b5f req-17cc6540-6272-4aab-93b9-74cfbb2c1eb2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:08.380214 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-d6cde1bd-797f-42dc-ab86-de6065ed7b5f req-17cc6540-6272-4aab-93b9-74cfbb2c1eb2 service nova] Creating event network-changed:edef25d3-094d-46dc-a85b-388645403cbd for instance 305651e2-488f-4fed-a8d9-2997709c96ea on hv-cinder-80660 Jun 21 10:03:08.385467 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-d6cde1bd-797f-42dc-ab86-de6065ed7b5f req-17cc6540-6272-4aab-93b9-74cfbb2c1eb2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035859 Jun 21 10:03:08.386075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 289/626] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:08.452775 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:08.453820 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] [instance: 7eaf513e-bb18-4125-9860-5d255c7cb7d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:08.460492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.461342 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:08.462664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.463426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:08.480396 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] HTTP exception thrown: Instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 could not be found. Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Request method failure captured: Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 HTTP/1.1 Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZaxzE80aSKWdYAzI7qqfBDSsdsspH_5_lO7o-pQiJIrbNTB9uHwS_Y--NkIR0CJEG_07encdsop-yiDZaIJd1NpGhB-KqIC6jwPlUQ3TJ1LAqWxPxSFg0e1__FiWW7GUTxBzO1weCe1KQis-kKIenRmtrq-xh3tQXi4ymGuVkGXBzw Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 8918c8442bf64ad28ea153a36b194f8a Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1871566194 Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:03:08.482426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8918c8442bf64ad28ea153a36b194f8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8918c8442bf64ad28ea153a36b194f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8918c8442bf64ad28ea153a36b194f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8918c8442bf64ad28ea153a36b194f8a"}]}] Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesSnapshotTestJSON-1871566194 Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 8918c8442bf64ad28ea153a36b194f8a Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1871566194 Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesSnapshotTestJSON-1871566194-project Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: dc1444d1ccf94601a11be7ed6f643798 Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesSnapshotTestJSON-1871566194-project Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 could not be found. Jun 21 10:03:08.483745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '7eaf513e-bb18-4125-9860-5d255c7cb7d5'} Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 could not be found. Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:03:08.484478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 could not be found. Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 could not be found. Jun 21 10:03:08.486154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:08.489997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] Returning 404 to user: Instance 7eaf513e-bb18-4125-9860-5d255c7cb7d5 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:03:08.491085 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-069a95d9-fd7f-434d-8dd3-52940a1f667d tempest-VolumesSnapshotTestJSON-1871566194 tempest-VolumesSnapshotTestJSON-1871566194-project] 10.222.0.36 "GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5" status: 404 len: 111 microversion: 2.1 time: 0.042386 Jun 21 10:03:08.492201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 338/627] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:08 2022] GET /compute/v2.1/servers/7eaf513e-bb18-4125-9860-5d255c7cb7d5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:03:08.935480 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:08.936255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:08.943076 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.943530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:08.944325 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:08.945081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:09.082370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:09.089855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1c126d0a-1653-4837-a59b-c01ccd8e1c2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.159126 Jun 21 10:03:09.090416 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 290/628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:08 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:09.175105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-ab06fd42-ed47-4ebf-83b6-8b1c4d591ebb req-5b02ee9e-d066-4e56-87df-0e221aca2500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1006e00-26c8-474c-b97b-8d599dff1cad", "tag": "fa3d5a86-7393-4180-9232-f187e89bd9ea"}, {"name": "network-changed", "server_uuid": "e1006e00-26c8-474c-b97b-8d599dff1cad", "tag": "fa3d5a86-7393-4180-9232-f187e89bd9ea"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:09.183664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ab06fd42-ed47-4ebf-83b6-8b1c4d591ebb req-5b02ee9e-d066-4e56-87df-0e221aca2500 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:09.184141 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ab06fd42-ed47-4ebf-83b6-8b1c4d591ebb req-5b02ee9e-d066-4e56-87df-0e221aca2500 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:09.196440 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-ab06fd42-ed47-4ebf-83b6-8b1c4d591ebb req-5b02ee9e-d066-4e56-87df-0e221aca2500 service nova] Creating event network-changed:fa3d5a86-7393-4180-9232-f187e89bd9ea for instance e1006e00-26c8-474c-b97b-8d599dff1cad on hv-cinder-80660 Jun 21 10:03:09.196952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-ab06fd42-ed47-4ebf-83b6-8b1c4d591ebb req-5b02ee9e-d066-4e56-87df-0e221aca2500 service nova] Creating event network-changed:fa3d5a86-7393-4180-9232-f187e89bd9ea for instance e1006e00-26c8-474c-b97b-8d599dff1cad on hv-cinder-80660 Jun 21 10:03:09.201888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-ab06fd42-ed47-4ebf-83b6-8b1c4d591ebb req-5b02ee9e-d066-4e56-87df-0e221aca2500 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030413 Jun 21 10:03:09.202456 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 339/629] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:09.317136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:09.317787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:09.323760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:09.324254 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:09.325048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:09.325487 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:09.453163 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:09.461564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d92084b6-5d63-4eae-926a-d4be204ca0c9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.148271 Jun 21 10:03:09.462126 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 291/630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:09 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:10.107903 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:10.108787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:10.115233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:10.115689 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:10.116502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:10.116945 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:10.314987 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:10.322492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5cdedd42-a3f5-486a-96b1-0f190b9dc7c3 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.219487 Jun 21 10:03:10.323040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 340/631] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:10 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:10.481073 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:10.481689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:10.489060 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:10.489510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:10.490274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:10.490713 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:10.621947 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:10.629332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7975e059-749e-47a6-84ed-d0ce1d87adec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.152150 Jun 21 10:03:10.629896 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 292/632] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:10 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:11.341457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:11.342062 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:11.349238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:11.349710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:11.350530 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:11.350979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:11.486516 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:11.494166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-43ec06f2-16db-41ae-9985-b65f3ea90139 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.156516 Jun 21 10:03:11.494714 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 341/633] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:11 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:11.645708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:11.646265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:11.652849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:11.653297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:11.654059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:11.654494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:11.784206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:11.791701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c8c516ad-1d95-4fa0-93bb-14ba2e9245af tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.149906 Jun 21 10:03:11.792336 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 293/634] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:11 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:12.511242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:12.511858 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:12.518999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:12.519446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:12.520240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:12.520672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:12.644116 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:12.651437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ef4637c9-7686-4c52-8b01-f693e4fb8c9d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.144047 Jun 21 10:03:12.652010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 342/635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:12 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:12.808852 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:12.809393 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:12.816478 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:12.816931 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:12.817693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:12.818127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:12.981232 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:12.991105 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-60c61a68-f868-43d3-895b-313af91c6211 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.186088 Jun 21 10:03:12.992065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 294/636] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:12 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:13.668185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:13.668808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:13.670772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:13.671538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=20 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:13.678315 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:13.678767 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:13.679550 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:13.680010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:13.803763 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:13.811083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ad2d396b-0dcc-4b1f-86f6-5022e9c17b0d tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.146831 Jun 21 10:03:13.811627 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 343/637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:13 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:14.007804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:14.008389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:14.014825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:14.015271 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:14.016050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:14.017124 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:14.153824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:14.161640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-544a7733-54af-4306-9601-bd590ff44c84 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.157734 Jun 21 10:03:14.162198 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 295/638] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:14 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:14.730984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-f9d13340-ab03-47ce-8018-6455da42dc47 req-cda08d07-1e86-4fe6-8b1b-2e2004f39415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305651e2-488f-4fed-a8d9-2997709c96ea", "name": "network-vif-plugged", "status": "completed", "tag": "edef25d3-094d-46dc-a85b-388645403cbd"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:14.743083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f9d13340-ab03-47ce-8018-6455da42dc47 req-cda08d07-1e86-4fe6-8b1b-2e2004f39415 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:14.743752 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f9d13340-ab03-47ce-8018-6455da42dc47 req-cda08d07-1e86-4fe6-8b1b-2e2004f39415 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:14.756533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-f9d13340-ab03-47ce-8018-6455da42dc47 req-cda08d07-1e86-4fe6-8b1b-2e2004f39415 service nova] Creating event network-vif-plugged:edef25d3-094d-46dc-a85b-388645403cbd for instance 305651e2-488f-4fed-a8d9-2997709c96ea on hv-cinder-80660 Jun 21 10:03:14.761631 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-f9d13340-ab03-47ce-8018-6455da42dc47 req-cda08d07-1e86-4fe6-8b1b-2e2004f39415 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Jun 21 10:03:14.762212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 344/639] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:14.827384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:14.828016 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:14.833949 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:14.834400 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:14.835149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:14.835589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:14.967934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:14.975880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3523be65-c40d-451d-925b-cd11a12f311c tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.152348 Jun 21 10:03:14.976461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 296/640] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:14 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:15.178682 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:15.179381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:15.185594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:15.186041 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:15.186803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:15.187240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:15.318412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:15.325797 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8fa5a9e8-5b40-45ef-a21e-466031803959 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.151290 Jun 21 10:03:15.326347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 345/641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:15 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:15.992570 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:15.993217 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:15.999941 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:16.000418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:16.001916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:16.002348 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:16.131706 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:16.139090 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-21568ffd-55c7-4957-9c95-26984e59a075 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1367 microversion: 2.1 time: 0.150623 Jun 21 10:03:16.139649 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 297/642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:15 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:16.342678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:16.343295 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:16.350493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:16.350947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:16.351770 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:16.352264 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:16.479635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:16.487036 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1fbee3c2-100d-4755-b4cb-79232c81ce94 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.148297 Jun 21 10:03:16.487589 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 346/643] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:16 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:17.155564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:17.156323 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:17.163599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:17.164205 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:17.165045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:17.165618 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:17.296459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:17.304525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cd8dbbb2-c58a-4f57-a3e7-2d2a25c4e062 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1556 microversion: 2.1 time: 0.152977 Jun 21 10:03:17.305091 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 298/644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:17 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:17.320376 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:17.320869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:17.326800 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:17.327252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:17.328061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:17.328509 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:17.405121 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e91d4e61-9e23-4e61-9ac9-ff1cd0f49dff tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088537 Jun 21 10:03:17.412413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 347/645] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 10:03:17 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:17.503915 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:17.504571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:17.510521 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:17.510974 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:17.511744 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:17.512290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:17.642939 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:17.651586 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ce7dd120-1e72-4aea-9ba7-1716e6b5cab3 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.151205 Jun 21 10:03:17.652302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 299/646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:17 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:18.562829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-22cd000d-3b7c-46ed-b008-5359844895ed req-8bac456f-1981-4e53-ab66-c70f2c5fa910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305651e2-488f-4fed-a8d9-2997709c96ea", "tag": "edef25d3-094d-46dc-a85b-388645403cbd"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:18.571005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-22cd000d-3b7c-46ed-b008-5359844895ed req-8bac456f-1981-4e53-ab66-c70f2c5fa910 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:18.571522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-22cd000d-3b7c-46ed-b008-5359844895ed req-8bac456f-1981-4e53-ab66-c70f2c5fa910 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:18.583156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-22cd000d-3b7c-46ed-b008-5359844895ed req-8bac456f-1981-4e53-ab66-c70f2c5fa910 service nova] Creating event network-changed:edef25d3-094d-46dc-a85b-388645403cbd for instance 305651e2-488f-4fed-a8d9-2997709c96ea on hv-cinder-80660 Jun 21 10:03:18.588282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-22cd000d-3b7c-46ed-b008-5359844895ed req-8bac456f-1981-4e53-ab66-c70f2c5fa910 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029518 Jun 21 10:03:18.588854 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 348/647] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:18.669259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:18.669985 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:18.676694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:18.677226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:18.678066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:18.678576 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:18.698909 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:18.810797 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:18.819017 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-23bdba59-770f-4dec-a818-d5d940998328 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.153603 Jun 21 10:03:18.819665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 300/648] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:18 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:19.836427 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:19.837048 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:19.843664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:19.844158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:19.845424 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:19.845859 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:19.975487 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:19.982985 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-33acb14e-6249-40bc-bbdf-fb840862c15a tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.151081 Jun 21 10:03:19.983549 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 349/649] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:19 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:20.642695 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-4be9cd65-e989-4d1f-9033-5be5a584c082 req-668d058a-2fc2-4341-bc72-d662332ec5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a76d1a-f9e8-459f-92ad-02a806ab20ab", "name": "network-vif-plugged", "status": "completed", "tag": "cc0f7d8e-9dc6-4782-8fb4-190065a75b9f"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:20.651555 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4be9cd65-e989-4d1f-9033-5be5a584c082 req-668d058a-2fc2-4341-bc72-d662332ec5e7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:20.652036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4be9cd65-e989-4d1f-9033-5be5a584c082 req-668d058a-2fc2-4341-bc72-d662332ec5e7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:20.662920 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-4be9cd65-e989-4d1f-9033-5be5a584c082 req-668d058a-2fc2-4341-bc72-d662332ec5e7 service nova] Creating event network-vif-plugged:cc0f7d8e-9dc6-4782-8fb4-190065a75b9f for instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab on hv-cinder-80660 Jun 21 10:03:20.667959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-4be9cd65-e989-4d1f-9033-5be5a584c082 req-668d058a-2fc2-4341-bc72-d662332ec5e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029487 Jun 21 10:03:20.668578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 301/650] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:21.000605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:21.001242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:21.007878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:21.008368 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:21.009172 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:21.009615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:21.013686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:21.137560 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:21.145674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dfe7aabc-d0b3-4ce4-b887-4ccee26505e1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.148913 Jun 21 10:03:21.146233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 350/651] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:20 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:22.163437 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:22.164125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:22.170322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:22.170774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:22.171545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:22.171994 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:22.337413 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:22.345170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-14d4c66b-6642-4f87-aaa2-a429bc923b4f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1267 microversion: 2.1 time: 0.186523 Jun 21 10:03:22.345733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 302/652] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:22 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:23.362232 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:23.362839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:23.369894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:23.370346 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:23.371143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:23.371576 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:23.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:23.522268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d0c37e53-d600-4dd6-8aca-7d133a96faf4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1453 microversion: 2.1 time: 0.164417 Jun 21 10:03:23.522818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 351/653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:23 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:23.538465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:23.539079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:23.545622 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:23.546069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:23.546835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:23.547268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:23.679629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:23.687228 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-89dce51f-e67f-471b-af2e-d34d6eaf5e53 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1453 microversion: 2.1 time: 0.152577 Jun 21 10:03:23.687839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 303/654] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:23 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:25.386295 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-3d0fe38a-23be-42d5-9dd0-d6793872713e req-fb76b845-4dfe-4119-a5ad-791b1fa037f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a76d1a-f9e8-459f-92ad-02a806ab20ab", "tag": "cc0f7d8e-9dc6-4782-8fb4-190065a75b9f"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:25.395396 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3d0fe38a-23be-42d5-9dd0-d6793872713e req-fb76b845-4dfe-4119-a5ad-791b1fa037f5 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:25.395839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3d0fe38a-23be-42d5-9dd0-d6793872713e req-fb76b845-4dfe-4119-a5ad-791b1fa037f5 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:25.408094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-3d0fe38a-23be-42d5-9dd0-d6793872713e req-fb76b845-4dfe-4119-a5ad-791b1fa037f5 service nova] Creating event network-changed:cc0f7d8e-9dc6-4782-8fb4-190065a75b9f for instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab on hv-cinder-80660 Jun 21 10:03:25.413040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-3d0fe38a-23be-42d5-9dd0-d6793872713e req-fb76b845-4dfe-4119-a5ad-791b1fa037f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030393 Jun 21 10:03:25.413628 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 352/655] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:33.804989 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:33.805519 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:33.808140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=39 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:33.808798 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=16 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:33.814914 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:33.815405 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:33.816207 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:33.816642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:33.845730 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-74008fce-c82e-4c0b-92cb-a585836bb965 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments/3ff0c222-b6c5-4147-af73-a8b1e9d505f3" status: 200 len: 194 microversion: 2.20 time: 0.044744 Jun 21 10:03:33.846286 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 304/656] 10.222.0.36 () {60 vars in 1453 bytes} [Tue Jun 21 10:03:33 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments/3ff0c222-b6c5-4147-af73-a8b1e9d505f3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:03:33.909107 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:33.909686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:33.911592 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:33.917274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:33.917659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:33.918508 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:33.918935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:34.002465 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lazy-loading 'services' on Instance uuid 64e76d7e-1544-4d7d-96d5-6dcca440579d {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:03:34.071561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-27eace16-7d19-42f3-a62a-412b1f011ffd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments/3ff0c222-b6c5-4147-af73-a8b1e9d505f3" status: 202 len: 0 microversion: 2.20 time: 0.167860 Jun 21 10:03:34.072443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 353/657] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jun 21 10:03:33 2022] DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments/3ff0c222-b6c5-4147-af73-a8b1e9d505f3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:03:34.080610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:34.081539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:34.087493 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:34.087944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:34.088937 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:34.089414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:34.121449 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-040e5dee-602b-411a-b8d4-ff25653eb0d7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044851 Jun 21 10:03:34.122011 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 305/658] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 10:03:34 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:03:35.134796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:35.135799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:35.141966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:35.142415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:35.143212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:35.143649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:35.174663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-39891dcc-09c9-4d29-88e9-af14760a69bd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044207 Jun 21 10:03:35.175233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 354/659] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 10:03:35 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:03:36.185545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:36.186426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:36.193133 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:36.193585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:36.194342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:36.194779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:36.223246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3ed649ae-8793-45d0-8f80-1889808dd788 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041816 Jun 21 10:03:36.223786 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 306/660] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 10:03:36 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:36.282313 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:36.282789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:36.289382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:36.289829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:36.290585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:36.291019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:36.315602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:03:36.386738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-544cda50-4a85-4ac9-bc4d-5766395d96fe tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 204 len: 0 microversion: 2.20 time: 0.107966 Jun 21 10:03:36.387314 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 355/661] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 10:03:36 2022] DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:03:36.397047 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:36.397869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:36.406465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:36.406921 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:36.407944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:36.408506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:36.536116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:36.544200 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:36.545777 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:36.546924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c86ffd4-d448-4ec8-a7f1-eadc944f118e tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.155344 Jun 21 10:03:36.547473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 307/662] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:36 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:37.566314 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:37.567031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:37.573393 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:37.573841 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:37.574595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:37.575029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:37.702603 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:37.711213 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:37.712749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:37.713905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e97e9d67-daf2-4231-b360-6c8759df9a55 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.151918 Jun 21 10:03:37.714461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 356/663] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:37 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:38.732299 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:38.732895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:38.740143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:38.740590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:38.741359 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:38.741796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:38.968059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:38.976001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:38.977507 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:38.978672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-28ffd47d-9377-41fc-9b43-ac21d2fb22b0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1720 microversion: 2.20 time: 0.250365 Jun 21 10:03:38.979435 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 308/664] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:38 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:39.589495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-f0db3812-cdbf-49c2-bd88-0ead593754cb req-2f7ff50e-5b94-4be6-91c3-21e76abbb711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e76d7e-1544-4d7d-96d5-6dcca440579d", "name": "network-vif-deleted", "tag": "9463cf10-d661-45cc-a90b-0bb3a05952a0"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:39.600401 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f0db3812-cdbf-49c2-bd88-0ead593754cb req-2f7ff50e-5b94-4be6-91c3-21e76abbb711 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:39.600933 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f0db3812-cdbf-49c2-bd88-0ead593754cb req-2f7ff50e-5b94-4be6-91c3-21e76abbb711 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:39.612621 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-f0db3812-cdbf-49c2-bd88-0ead593754cb req-2f7ff50e-5b94-4be6-91c3-21e76abbb711 service nova] Creating event network-vif-deleted:9463cf10-d661-45cc-a90b-0bb3a05952a0 for instance 64e76d7e-1544-4d7d-96d5-6dcca440579d on hv-cinder-80660 Jun 21 10:03:39.617656 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-f0db3812-cdbf-49c2-bd88-0ead593754cb req-2f7ff50e-5b94-4be6-91c3-21e76abbb711 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Jun 21 10:03:39.618695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 357/665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:39.997559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:39.998170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:40.005144 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:40.005596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:40.006368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:40.006796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:40.037488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:40.037949 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:40.038385 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lazy-loading 'fault' on Instance uuid 64e76d7e-1544-4d7d-96d5-6dcca440579d {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:03:40.078153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:40.086623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:40.088152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:40.089315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2a2109b3-8783-4b2e-b80c-d10adec4690b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 200 len: 1370 microversion: 2.20 time: 0.095699 Jun 21 10:03:40.090097 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 309/666] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:39 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:41.107634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:41.108394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:41.114798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:41.115247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:41.116030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:41.116470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:41.129274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] HTTP exception thrown: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Request method failure captured: Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d HTTP/1.1 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZlrRyWZZMkmDwMrt2OftkZmcx6XnyPhBJQH61KNCg2f--1c0nHPMC7EOTbMofBbb5jO9jfUZ-5N6KtJg-OrBTw5mhowwuEdvLf5DSDB4bugrexkQBWj9wBqQNJWF2Dblye5t7VEHVW81VuabnrYmGsnR0xX7sLMJdOWQI9I-hbi50 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:03:41.130850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/318fe395ab574501973a3a20d0c77bfc"}]}] Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: bf85b80a4bb747da9bd07454536380c0 Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:03:41.132544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '64e76d7e-1544-4d7d-96d5-6dcca440579d'} Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:03:41.133605 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:03:41.135076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:41.136588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Returning 404 to user: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:03:41.136588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6c1fb329-0aab-4ca0-b705-b8d75880436c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 404 len: 111 microversion: 2.20 time: 0.029258 Jun 21 10:03:41.136588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 358/667] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:41 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:03:41.140926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eab837d5-dc3e-4165-9450-c592090629a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '.version_select at 0x7f184ab069d0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:41.158719 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eab837d5-dc3e-4165-9450-c592090629a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878155602" status: 204 len: 0 microversion: 2.20 time: 0.021567 Jun 21 10:03:41.159259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 310/668] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Jun 21 10:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878155602 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:03:41.781738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-88099f6c-6e70-44ad-bdff-13211477dd17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'create', calling method: .version_select at 0x7f184aafc040>, body: {"keypair": {"name": "tempest-keypair-1020337206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENatpMMaRsNyB4/xSKPYb83qM8TXI6s1gEAakSYApvLAU2RganZgu+uaeqKEGB1B9G/6Lg3drLOkXoZG5d83Wj3O9jyMKH+yByNYtBeq3waNxONsUgH3NguO2W9pxOCfw=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:41.795251 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-88099f6c-6e70-44ad-bdff-13211477dd17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for project 318fe395ab574501973a3a20d0c77bfc. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:03:41.799006 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-88099f6c-6e70-44ad-bdff-13211477dd17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for user bf85b80a4bb747da9bd07454536380c0 and project 318fe395ab574501973a3a20d0c77bfc. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:03:41.821875 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-88099f6c-6e70-44ad-bdff-13211477dd17 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044078 Jun 21 10:03:41.822530 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 359/669] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jun 21 10:03:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 10:03:43.505134 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-100025564", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e57ecdad-5631-4120-8112-a6e1a027f20d"}], "security_groups": [{"name": "tempest-securitygroup--1961233296"}], "key_name": "tempest-keypair-1020337206", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:43.602714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] validate_networks() for [('e57ecdad-5631-4120-8112-a6e1a027f20d', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:03:43.961713 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:03:43.962133 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:03:43.962735 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:03:43.963342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:03:43.963934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:03:43.974245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:43.974685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:43.975465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:43.975895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:43.992916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for project 318fe395ab574501973a3a20d0c77bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:03:43.996828 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Getting quotas for user bf85b80a4bb747da9bd07454536380c0 and project 318fe395ab574501973a3a20d0c77bfc. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:03:44.007503 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:03:44.009761 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:03:44.056045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9f4e1fd3-c8ee-44b1-b0e9-d1255fe30b2d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.555822 Jun 21 10:03:44.056695 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 311/670] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jun 21 10:03:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 21 10:03:44.067173 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9d78478e-35b5-497e-ac42-55e939cca27f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:44.067809 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9d78478e-35b5-497e-ac42-55e939cca27f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:44.122723 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9d78478e-35b5-497e-ac42-55e939cca27f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:44.130971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9d78478e-35b5-497e-ac42-55e939cca27f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:44.132672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9d78478e-35b5-497e-ac42-55e939cca27f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:44.133827 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9d78478e-35b5-497e-ac42-55e939cca27f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1281 microversion: 2.20 time: 0.071058 Jun 21 10:03:44.134384 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 360/671] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:44 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:45.152948 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:45.153561 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:45.160932 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:45.161386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:45.162159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:45.162609 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:45.227757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:45.235757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:45.237310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:45.239306 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5a1d8916-21ae-4bc7-b543-6fb8666ff3b8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1333 microversion: 2.20 time: 0.090508 Jun 21 10:03:45.239873 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 312/672] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:45 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:46.259467 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:46.260120 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:46.266960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:46.267415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:46.268219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:46.268662 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:46.403293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:46.411551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:46.413066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:46.414178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b7500d7a-65b0-4acf-bfd3-1c14376385fc tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.159799 Jun 21 10:03:46.414736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 361/673] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:46 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:46.737294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-e01323b4-e275-4ebf-9932-2c3f73fe1aee req-e6bc19a0-e510-4528-a0a5-6e43b2d684a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:46.755768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e01323b4-e275-4ebf-9932-2c3f73fe1aee req-e6bc19a0-e510-4528-a0a5-6e43b2d684a6 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:46.756234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e01323b4-e275-4ebf-9932-2c3f73fe1aee req-e6bc19a0-e510-4528-a0a5-6e43b2d684a6 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:46.767858 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-e01323b4-e275-4ebf-9932-2c3f73fe1aee req-e6bc19a0-e510-4528-a0a5-6e43b2d684a6 service nova] Creating event network-changed:566f28fb-8556-4b14-a4d3-7df74e335933 for instance e013028d-603c-49de-ad9f-d8f583b1b516 on hv-cinder-80660 Jun 21 10:03:46.772928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-e01323b4-e275-4ebf-9932-2c3f73fe1aee req-e6bc19a0-e510-4528-a0a5-6e43b2d684a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043954 Jun 21 10:03:46.774015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 313/674] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:47.432276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:47.432893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:47.439448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:47.439899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:47.440703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:47.441646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:47.575606 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:47.584015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:47.585506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:47.586608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-95f752ef-e7d5-4c40-8708-5b5028c67294 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.158337 Jun 21 10:03:47.587156 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 362/675] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:47 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:48.154364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:48.155369 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:48.162077 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.162571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.163342 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.163783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.194244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5e2ffac8-ed33-43f0-a492-66e777a41b38 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044555 Jun 21 10:03:48.195168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 314/676] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:48 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:03:48.252109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:48.252607 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:48.258594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.259043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.259808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.260272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.284302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:03:48.362047 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b05c388d-8b16-4bb7-aede-553b938806f3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 204 len: 0 microversion: 2.1 time: 0.113431 Jun 21 10:03:48.362816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 363/677] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:03:48 2022] DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:03:48.371802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:48.372440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:48.379426 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.379869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.380658 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.381128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.605146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:48.605938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:48.612342 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.612788 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.613555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:48.613988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:48.671399 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:48.679288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b2bb3f90-f358-45d8-af9d-dd5aca53930f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1673 microversion: 2.1 time: 0.311640 Jun 21 10:03:48.679853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 315/678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:48 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:48.743781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:48.751658 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:48.753193 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:48.754320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d9f21203-8aa8-4b8e-bff6-5fa749398dd4 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.153386 Jun 21 10:03:48.754866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 364/679] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:48 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:03:49.696644 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:49.697277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:49.703796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:49.704457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:49.705218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:49.705651 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:49.772668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:49.773301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:49.779701 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:49.780199 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:49.780966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:49.781405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:49.834186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:49.841918 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5bb765ed-0865-4166-a83a-cdaad4e64053 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1673 microversion: 2.1 time: 0.149037 Jun 21 10:03:49.842486 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 316/680] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:49 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:49.912242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:49.920573 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:49.922043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:49.923167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b8bff896-a4c1-4d38-aeb6-38819f85ebe9 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.155007 Jun 21 10:03:49.923717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 365/681] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:49 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:03:50.858926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:50.859541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:50.866880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:50.867339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:50.868131 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:50.868569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:50.938058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1808739080"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:50.938593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:50.945302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:50.945746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:50.946506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:50.946942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:50.995837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:51.003378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b30bb5de-4726-4d6a-a8ee-c8882f465880 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1673 microversion: 2.1 time: 0.148338 Jun 21 10:03:51.004800 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 317/682] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:50 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:51.009109 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:51.009719 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:51.015953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:51.016582 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:51.017357 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:51.017790 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:51.075413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.network.security_group_api [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Removing security group cc75edb9-e487-4fd2-bfde-387b6c7c1260 from port 5e690880-831e-4245-ae93-a349bd151897 Jun 21 10:03:51.150553 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:51.158601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:51.160811 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:51.161796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b168ca46-2e58-43fe-b59d-54a4f79e0210 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.156264 Jun 21 10:03:51.162543 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 318/683] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:51 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:51.413664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2834246d-907e-4a9b-9416-a1d9b1df0de1 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/action" status: 202 len: 0 microversion: 2.1 time: 0.479543 Jun 21 10:03:51.414469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 366/684] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:03:50 2022] POST /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:03:51.429316 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-2b5cab86-b855-4801-871c-4030ba7e9eb2 req-e9c267cf-a58e-4f9c-af35-49887fed772a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:51.440460 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-2b5cab86-b855-4801-871c-4030ba7e9eb2 req-e9c267cf-a58e-4f9c-af35-49887fed772a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:51.441247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-2b5cab86-b855-4801-871c-4030ba7e9eb2 req-e9c267cf-a58e-4f9c-af35-49887fed772a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:51.464874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-2b5cab86-b855-4801-871c-4030ba7e9eb2 req-e9c267cf-a58e-4f9c-af35-49887fed772a service nova] Creating event network-changed:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:03:51.471681 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-2b5cab86-b855-4801-871c-4030ba7e9eb2 req-e9c267cf-a58e-4f9c-af35-49887fed772a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049439 Jun 21 10:03:51.475922 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 319/685] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:52.021754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:52.022639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:52.030646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:52.032118 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:52.032914 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:52.033352 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:52.038330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:52.180617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:52.181547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:52.189860 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:52.190738 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:52.191814 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:52.192777 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:52.348025 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:52.357598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2bc24531-311e-4b14-bc09-2e0382f7653d tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1673 microversion: 2.1 time: 0.340350 Jun 21 10:03:52.358166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 367/686] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:52 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1673 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:52.644072 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:52.653452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:52.655304 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:52.656545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8d41633f-9143-4b93-aaf8-03e62cca619f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.481583 Jun 21 10:03:52.666836 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 320/687] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:52 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:52.988671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:52.989414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:53.000901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.001366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.002155 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.002589 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.151227 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lazy-loading 'services' on Instance uuid b743e374-11d0-4805-a7d3-bca78cc11184 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:03:53.256818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d4c3b982-107b-4965-a9c8-3267f7151b4c tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments/f927bf1d-0798-4a37-9be9-47b94a1f9c0a" status: 202 len: 0 microversion: 2.1 time: 0.272398 Jun 21 10:03:53.257623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 368/688] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:03:52 2022] DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments/f927bf1d-0798-4a37-9be9-47b94a1f9c0a => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:03:53.265924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:53.266854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:53.273484 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.274192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.275139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.275733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.306427 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dafa3386-7f7f-4f47-af5f-6c72bfd1486a tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Jun 21 10:03:53.307564 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 321/689] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:53 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:53.520626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:53.521341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:53.528538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.528991 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.530240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.530844 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.602109 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-fbac1518-e600-4a44-af22-c24c6ce8579d req-c019d4df-5f79-4127-ae3d-c1063de71bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:53.617107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-fbac1518-e600-4a44-af22-c24c6ce8579d req-c019d4df-5f79-4127-ae3d-c1063de71bb3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.617844 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-fbac1518-e600-4a44-af22-c24c6ce8579d req-c019d4df-5f79-4127-ae3d-c1063de71bb3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.647500 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:53.663267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d6e979fb-81eb-4e0f-93eb-85853a7865a9 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 200 len: 1606 microversion: 2.1 time: 0.291839 Jun 21 10:03:53.663860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 369/690] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:53 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 1606 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:53.680404 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-fbac1518-e600-4a44-af22-c24c6ce8579d req-c019d4df-5f79-4127-ae3d-c1063de71bb3 service nova] Creating event network-changed:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:03:53.689527 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:53.690579 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:53.694007 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-fbac1518-e600-4a44-af22-c24c6ce8579d req-c019d4df-5f79-4127-ae3d-c1063de71bb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098595 Jun 21 10:03:53.695494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 322/691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:53.702358 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.703087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:53.703869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:53.704486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:54.002142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:54.011053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:54.012689 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:54.013912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0f7ece4b-0cab-4760-9f9f-0ed41ec097b5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.338301 Jun 21 10:03:54.024341 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 370/692] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:53 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:54.316104 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:54.317032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:54.322204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:54.323207 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:54.330389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:54.330839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:54.331606 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:54.332087 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:54.358086 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:54.364545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6708ee97-c99f-4dc9-a861-b3dc9a515e2e tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049095 Jun 21 10:03:54.365112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 323/693] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:54 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:54.681800 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:54.682415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:54.685086 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:54.692190 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:54.692666 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:54.693911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:54.694360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:54.710489 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] HTTP exception thrown: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Request method failure captured: Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe HTTP/1.1 Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZcFEDIjf-b2T8rRfNe-KhcFNKhN7hQgzFuzOewCtYyw6W5Bk5mx0CPbrxJIPCUUM2qn-pZyt_UBFHDnpNNFh_WtgKYgtNn_SF2zw7oWCOfuuzJrynbRCDmTa-QtUjRXhJ4nQ8-AhGdPrkbPPU3ikr_pRl1ztcqO6U5aw0ru16_Rao Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:03:54.712197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8dc9e553cda4326a9dd10c3e0a35546"}]}] Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 1fde108762d645bc9c5c5791dfe646a0 Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:03:54.713864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe'} Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:03:54.715851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:03:54.717642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:54.718932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Returning 404 to user: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:03:54.718932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-848aca03-b0a1-4305-8698-4c94df9ab314 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 404 len: 111 microversion: 2.1 time: 0.035714 Jun 21 10:03:54.718932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 371/694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:54 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:03:54.724742 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6886611b-9d40-4cbf-8322-90a11c401d58 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '.version_select at 0x7f184ab889d0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:54.742911 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6886611b-9d40-4cbf-8322-90a11c401d58 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030354336" status: 202 len: 0 microversion: 2.1 time: 0.022880 Jun 21 10:03:54.743490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 324/695] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 10:03:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030354336 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:03:55.031117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:55.032078 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:55.038830 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.039259 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.040244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.040830 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.055418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-48b741a7-92c8-400b-b6b1-8b62eb7cab94 req-a88e73ec-2ff2-4cd4-ba4c-461ed24c56d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "name": "network-vif-plugged", "status": "completed", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:55.070905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-48b741a7-92c8-400b-b6b1-8b62eb7cab94 req-a88e73ec-2ff2-4cd4-ba4c-461ed24c56d2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.071629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-48b741a7-92c8-400b-b6b1-8b62eb7cab94 req-a88e73ec-2ff2-4cd4-ba4c-461ed24c56d2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.084482 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-48b741a7-92c8-400b-b6b1-8b62eb7cab94 req-a88e73ec-2ff2-4cd4-ba4c-461ed24c56d2 service nova] Creating event network-vif-plugged:566f28fb-8556-4b14-a4d3-7df74e335933 for instance e013028d-603c-49de-ad9f-d8f583b1b516 on hv-cinder-80660 Jun 21 10:03:55.089719 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-48b741a7-92c8-400b-b6b1-8b62eb7cab94 req-a88e73ec-2ff2-4cd4-ba4c-461ed24c56d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038888 Jun 21 10:03:55.090973 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 325/696] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:55.250781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:55.259668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:55.261849 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:55.262966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-85ff0dbc-07a6-4ac2-aa7a-04525ea8c31a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.236030 Jun 21 10:03:55.263990 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 372/697] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:55 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:55.380222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:55.381347 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:55.389578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.390113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.391026 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.391570 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.423812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-30cb3efb-e2be-43f5-8538-c51aa8e62f3f tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051132 Jun 21 10:03:55.429599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 326/698] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:55 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:03:55.436257 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:55.436803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:55.444975 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.445426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.446394 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.446990 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.480260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:55.480877 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:55.487414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.488511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.489840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.490376 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.528149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] HTTP exception thrown: Instance b743e374-11d0-4805-a7d3-bca78cc11184 is not attached to volume f927bf1d-0798-4a37-9be9-47b94a1f9c0a Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Request method failure captured: Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments/f927bf1d-0798-4a37-9be9-47b94a1f9c0a HTTP/1.1 Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZbEI4NqMjzM4RjOrhTMOB2IeoLKGEoB3A5q4zP6UsoDp8At_xhzFR-50AbRbHZUl9chIkzjU9-qpuQxJU_RZ-dlRWC3TX8U_MocRu3FtILf4xsEoVOyJPMxh1doK6wRdN6OViAvjuLCoaBxUXTLZJ8EfWPV2mahZc-11knufackJBE Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 705097e0a13f400d820a4e6c6720c101 Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestMinimumBasicScenario-239634948 Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:03:55.530543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_705097e0a13f400d820a4e6c6720c101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/705097e0a13f400d820a4e6c6720c101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/705097e0a13f400d820a4e6c6720c101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/705097e0a13f400d820a4e6c6720c101"}]}] Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestMinimumBasicScenario-239634948 Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 705097e0a13f400d820a4e6c6720c101 Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestMinimumBasicScenario-239634948 Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-TestMinimumBasicScenario-239634948-project Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: cd37e2b041ae441fb1c1ae1d77570820 Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestMinimumBasicScenario-239634948-project Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:03:55.531846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance b743e374-11d0-4805-a7d3-bca78cc11184 is not attached to volume f927bf1d-0798-4a37-9be9-47b94a1f9c0a Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'server_id': 'b743e374-11d0-4805-a7d3-bca78cc11184', 'id': 'f927bf1d-0798-4a37-9be9-47b94a1f9c0a'} Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f927bf1d-0798-4a37-9be9-47b94a1f9c0a. Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:03:55.532680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b743e374-11d0-4805-a7d3-bca78cc11184 is not attached to volume f927bf1d-0798-4a37-9be9-47b94a1f9c0a Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b743e374-11d0-4805-a7d3-bca78cc11184 is not attached to volume f927bf1d-0798-4a37-9be9-47b94a1f9c0a Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:03:55.534084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Returning 404 to user: Instance b743e374-11d0-4805-a7d3-bca78cc11184 is not attached to volume f927bf1d-0798-4a37-9be9-47b94a1f9c0a {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:03:55.535165 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8ba90608-db60-411a-8e93-b2fefdb3ab36 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments/f927bf1d-0798-4a37-9be9-47b94a1f9c0a" status: 404 len: 154 microversion: 2.1 time: 0.100991 Jun 21 10:03:55.536149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 373/699] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:03:55 2022] DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184/os-volume_attachments/f927bf1d-0798-4a37-9be9-47b94a1f9c0a => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:03:55.576799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5184d2b2-0b5d-4a3a-8224-a2a014a0a260 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: .version_select at 0x7f184abf69d0>, body: {"keypair": {"name": "tempest-keypair-1712604290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9PlUIaYN8dHu919Gn/kd9pCLSPEgZY97AX33egPgLKPxR07CfCYvMnk5Cc+v62lj6nrVRkhWvx/Ome0gPWN0Qoe6bKRDULSzA5h280ZQEkgRNHYAbrwKUaWUHNgB//Dw=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:55.592699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-5184d2b2-0b5d-4a3a-8224-a2a014a0a260 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:03:55.597282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-5184d2b2-0b5d-4a3a-8224-a2a014a0a260 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for user 1fde108762d645bc9c5c5791dfe646a0 and project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:03:55.627195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5184d2b2-0b5d-4a3a-8224-a2a014a0a260 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054304 Jun 21 10:03:55.627789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 374/700] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:03:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:55.734648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-0c9ac6ed-4987-4402-9e6b-b3b9a06ddb8f req-6e486a01-035e-4475-951a-f388e60f1755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe", "name": "network-vif-deleted", "tag": "ee93fa93-b873-48d0-8002-d8977f4de733"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:55.744111 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-0c9ac6ed-4987-4402-9e6b-b3b9a06ddb8f req-6e486a01-035e-4475-951a-f388e60f1755 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.744633 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-0c9ac6ed-4987-4402-9e6b-b3b9a06ddb8f req-6e486a01-035e-4475-951a-f388e60f1755 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.748888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lazy-loading 'services' on Instance uuid e1006e00-26c8-474c-b97b-8d599dff1cad {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:03:55.758799 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-0c9ac6ed-4987-4402-9e6b-b3b9a06ddb8f req-6e486a01-035e-4475-951a-f388e60f1755 service nova] Creating event network-vif-deleted:ee93fa93-b873-48d0-8002-d8977f4de733 for instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe on hv-cinder-80660 Jun 21 10:03:55.765299 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-0c9ac6ed-4987-4402-9e6b-b3b9a06ddb8f req-6e486a01-035e-4475-951a-f388e60f1755 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Jun 21 10:03:55.765824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 375/701] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:55.827810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b3240cce-5309-48e0-9566-e3dcbebf0203 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments/725f8ec5-75d8-49e2-8217-ffded7306fd2" status: 202 len: 0 microversion: 2.1 time: 0.354968 Jun 21 10:03:55.828931 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 327/702] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:03:55 2022] DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments/725f8ec5-75d8-49e2-8217-ffded7306fd2 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:03:55.840331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:55.841177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:55.848146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.848680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.849535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:55.849978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:55.880860 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c223d8ba-bcbd-4795-8ce7-f0a66cebdc27 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Jun 21 10:03:55.881780 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 376/703] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:55 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:56.281925 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:56.282627 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:56.289488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.289941 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.290714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.291351 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.430704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:56.439809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:56.441385 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:56.442510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b64bf4e5-03cd-400e-92d1-e7e564aa29d3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1407 microversion: 2.20 time: 0.165300 Jun 21 10:03:56.443065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 328/704] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:56 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:03:56.693334 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:56.693904 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:56.699950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.700532 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.701418 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.701919 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.736664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:03:56.823318 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b4145467-8d2b-4af2-88ef-50b92686ea63 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 204 len: 0 microversion: 2.1 time: 0.133855 Jun 21 10:03:56.826912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 377/705] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:03:56 2022] DELETE /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:03:56.833922 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:56.834630 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:56.841082 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.841535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.842311 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.842783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.893920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:56.895416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:56.901884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.902328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.903095 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:56.903533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:56.939706 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b281a7e6-9ff5-4063-bfa2-51abdf8c7d03 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050429 Jun 21 10:03:56.943904 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 378/706] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:56 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:56.948966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1209165381", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e515ef0a-1336-465c-b3d6-451df27d3301"}], "security_groups": [{"name": "tempest-securitygroup--230201990"}], "key_name": "tempest-keypair-1712604290", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:57.014567 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:57.022714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4141036a-7a8b-4269-96f4-00781a9e0203 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1555 microversion: 2.1 time: 0.193572 Jun 21 10:03:57.023276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 329/707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:56 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:57.059930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] validate_networks() for [('e515ef0a-1336-465c-b3d6-451df27d3301', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:03:57.437610 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:03:57.438026 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:03:57.438496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:03:57.438901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:03:57.439309 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:03:57.449473 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.449846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.451051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.451051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.460896 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:57.461510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:57.467835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.468331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.468624 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:03:57.469141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.469575 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.471123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:57.473784 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Getting quotas for user 1fde108762d645bc9c5c5791dfe646a0 and project c8dc9e553cda4326a9dd10c3e0a35546. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:03:57.487400 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:03:57.490844 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:03:57.538608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d0732f40-386a-4dc6-8861-ab2140d03dac tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593597 Jun 21 10:03:57.539527 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 379/708] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:03:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:03:57.549386 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-01b59743-651b-4bbe-a2ed-28010966d654 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:57.549995 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-01b59743-651b-4bbe-a2ed-28010966d654 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:57.606829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-01b59743-651b-4bbe-a2ed-28010966d654 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:57.610152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:57.615356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-01b59743-651b-4bbe-a2ed-28010966d654 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1238 microversion: 2.1 time: 0.069647 Jun 21 10:03:57.616014 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 380/709] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:57 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:57.619370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:57.620981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:57.622147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eb66b019-859f-4d48-b5e9-01d689e5e096 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1599 microversion: 2.20 time: 0.165784 Jun 21 10:03:57.622685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 330/710] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:03:57 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:03:57.638966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:57.639460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:57.646243 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.646783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.647618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.648180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.727320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b1f7002d-856b-4b69-9568-6bf651aa2aca tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092059 Jun 21 10:03:57.727948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 381/711] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jun 21 10:03:57 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:03:57.952790 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:57.953815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:57.961133 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.961594 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.962374 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:57.962818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:57.997489 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7861f89c-f5f9-494c-a647-55557c8cc9e1 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049813 Jun 21 10:03:57.998340 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 331/712] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:57 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:58.041115 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:58.042386 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:58.048808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:58.049254 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:58.050055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:58.050551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:58.284000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:58.293425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-312869fb-0423-4232-8eb6-887113e01111 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1555 microversion: 2.1 time: 0.258332 Jun 21 10:03:58.293996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 382/713] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:58 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:03:58.633039 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:58.634216 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:58.640213 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:58.640670 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:58.641447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:58.641889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:58.720093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:58.727997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1522c9f9-3d10-4ed9-92e9-d24f71e44de6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1242 microversion: 2.1 time: 0.099746 Jun 21 10:03:58.728842 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 332/714] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:58 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:58.729013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-ce657ead-aa40-4716-b06c-eb509cd05cff req-0b20a6f9-8a34-4918-80b2-a505bf5e6a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:03:58.738272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ce657ead-aa40-4716-b06c-eb509cd05cff req-0b20a6f9-8a34-4918-80b2-a505bf5e6a46 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:58.738794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ce657ead-aa40-4716-b06c-eb509cd05cff req-0b20a6f9-8a34-4918-80b2-a505bf5e6a46 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:58.749999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-ce657ead-aa40-4716-b06c-eb509cd05cff req-0b20a6f9-8a34-4918-80b2-a505bf5e6a46 service nova] Creating event network-changed:566f28fb-8556-4b14-a4d3-7df74e335933 for instance e013028d-603c-49de-ad9f-d8f583b1b516 on hv-cinder-80660 Jun 21 10:03:58.755380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-ce657ead-aa40-4716-b06c-eb509cd05cff req-0b20a6f9-8a34-4918-80b2-a505bf5e6a46 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030028 Jun 21 10:03:58.756076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 383/715] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:03:59.009843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:59.010971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:59.017326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:59.017781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:59.018559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:59.019000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:59.047455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d1de4a71-2896-40ef-998f-f8d4fa9af7a0 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041579 Jun 21 10:03:59.048036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 333/716] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:03:59 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:03:59.311339 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:59.312758 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:59.321595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:59.323424 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:59.324246 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:59.324691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:59.477263 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:59.484924 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8f4cde1c-ba7e-472b-a997-2f167259a256 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1555 microversion: 2.1 time: 0.178533 Jun 21 10:03:59.485510 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 384/717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:59 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:03:59.745301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:03:59.746689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:03:59.754850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:59.755484 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:59.760788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:03:59.762102 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:03:59.860050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:03:59.870568 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f3848c53-1c13-42a0-94dd-cd01a779c9d8 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1290 microversion: 2.1 time: 0.129641 Jun 21 10:03:59.871150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 334/718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:03:59 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1290 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:00.059186 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:00.060303 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:00.068946 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.069831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.070945 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.071722 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.117832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-df897dac-c76e-4c74-8b0e-d6aa46766f53 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062860 Jun 21 10:04:00.122718 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 385/719] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:00 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:00.251307 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-dfa3bcfa-16db-4fee-aacd-83c1f9d6c942 req-986919c9-ca14-4738-99f0-c56e2612a3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743e374-11d0-4805-a7d3-bca78cc11184", "name": "network-vif-deleted", "tag": "5e690880-831e-4245-ae93-a349bd151897"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:00.261282 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dfa3bcfa-16db-4fee-aacd-83c1f9d6c942 req-986919c9-ca14-4738-99f0-c56e2612a3e7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.261870 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dfa3bcfa-16db-4fee-aacd-83c1f9d6c942 req-986919c9-ca14-4738-99f0-c56e2612a3e7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.273972 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-dfa3bcfa-16db-4fee-aacd-83c1f9d6c942 req-986919c9-ca14-4738-99f0-c56e2612a3e7 service nova] Creating event network-vif-deleted:5e690880-831e-4245-ae93-a349bd151897 for instance b743e374-11d0-4805-a7d3-bca78cc11184 on hv-cinder-80660 Jun 21 10:04:00.279913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-dfa3bcfa-16db-4fee-aacd-83c1f9d6c942 req-986919c9-ca14-4738-99f0-c56e2612a3e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032777 Jun 21 10:04:00.285368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 335/720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:00.505754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:00.506389 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:00.523408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.524371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.525404 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.528546 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.553144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:00.572727 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.573458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.574082 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lazy-loading 'fault' on Instance uuid b743e374-11d0-4805-a7d3-bca78cc11184 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:04:00.639732 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd37e2b041ae441fb1c1ae1d77570820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705097e0a13f400d820a4e6c6720c101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:00.651195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-107df156-69fe-4820-ae31-a5fcb3d6fda2 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 200 len: 1349 microversion: 2.1 time: 0.152197 Jun 21 10:04:00.651949 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 386/721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:00 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 1349 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:00.887156 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:00.888595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:00.896769 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.897214 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.897980 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:00.898414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:00.959531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:00.967369 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-426f599e-c977-4bd5-83e9-d09810bb339f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1296 microversion: 2.1 time: 0.084383 Jun 21 10:04:00.967925 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 336/722] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:00 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:01.130407 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:01.131418 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:01.138013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.138623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.139439 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.139926 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.170616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ad9ab16a-510d-4dd6-be30-a1d0ca3cf83a tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044596 Jun 21 10:04:01.171174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 387/723] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:01 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:04:01.243107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:01.243889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:01.250154 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.250829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.251596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.252588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.281909 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:04:01.361648 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ee2b5f0a-d37f-41fe-9a45-b3394589de19 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 204 len: 0 microversion: 2.1 time: 0.123510 Jun 21 10:04:01.362571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 337/724] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:04:01 2022] DELETE /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:04:01.371020 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:01.371622 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:01.379731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.380215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.380971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.381402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.521247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:01.529832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d2cddb4d-34ae-4184-b41d-918f27d7526e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1687 microversion: 2.1 time: 0.162500 Jun 21 10:04:01.530409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 388/725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:01 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:01.669441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:01.670140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] [instance: b743e374-11d0-4805-a7d3-bca78cc11184] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:01.677067 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.677521 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.678305 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.678761 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.692180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] HTTP exception thrown: Instance b743e374-11d0-4805-a7d3-bca78cc11184 could not be found. Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Request method failure captured: Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 HTTP/1.1 Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZbEI4NqMjzM4RjOrhTMOB2IeoLKGEoB3A5q4zP6UsoDp8At_xhzFR-50AbRbHZUl9chIkzjU9-qpuQxJU_RZ-dlRWC3TX8U_MocRu3FtILf4xsEoVOyJPMxh1doK6wRdN6OViAvjuLCoaBxUXTLZJ8EfWPV2mahZc-11knufackJBE Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 705097e0a13f400d820a4e6c6720c101 Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-TestMinimumBasicScenario-239634948 Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:01.693855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_705097e0a13f400d820a4e6c6720c101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/705097e0a13f400d820a4e6c6720c101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/705097e0a13f400d820a4e6c6720c101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/705097e0a13f400d820a4e6c6720c101"}]}] Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-TestMinimumBasicScenario-239634948 Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 705097e0a13f400d820a4e6c6720c101 Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-TestMinimumBasicScenario-239634948 Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-TestMinimumBasicScenario-239634948-project Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: cd37e2b041ae441fb1c1ae1d77570820 Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-TestMinimumBasicScenario-239634948-project Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance b743e374-11d0-4805-a7d3-bca78cc11184 could not be found. Jun 21 10:04:01.695294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'b743e374-11d0-4805-a7d3-bca78cc11184'} Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b743e374-11d0-4805-a7d3-bca78cc11184 could not be found. Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:01.696818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b743e374-11d0-4805-a7d3-bca78cc11184 could not be found. Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b743e374-11d0-4805-a7d3-bca78cc11184 could not be found. Jun 21 10:04:01.698276 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:01.700001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Returning 404 to user: Instance b743e374-11d0-4805-a7d3-bca78cc11184 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:01.700001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4d50fecd-1525-4b5d-86ad-0638ac050e00 tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184" status: 404 len: 111 microversion: 2.1 time: 0.030041 Jun 21 10:04:01.700001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 338/726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:01 2022] GET /compute/v2.1/servers/b743e374-11d0-4805-a7d3-bca78cc11184 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:01.703840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-14cd19ab-555e-408e-8dc3-d91fecf257ec tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] Calling method '.version_select at 0x7f184aabe820>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:01.721574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-14cd19ab-555e-408e-8dc3-d91fecf257ec tempest-TestMinimumBasicScenario-239634948 tempest-TestMinimumBasicScenario-239634948-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1601979602" status: 202 len: 0 microversion: 2.1 time: 0.021503 Jun 21 10:04:01.722160 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 389/727] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Jun 21 10:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1601979602 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:04:01.983464 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:01.984115 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:01.987574 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:01.993344 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.993748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:01.994509 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:01.994942 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:02.138505 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:02.147226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8dbc565e-ef00-4574-b57c-27305b640d03 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.167390 Jun 21 10:04:02.147876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 339/728] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:01 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:02.547551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:02.548310 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:02.555286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:02.555892 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:02.556895 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:02.557328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:02.761900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:02.769715 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b858fe33-6ef0-4b3e-b2df-62c290b59563 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1687 microversion: 2.1 time: 0.226900 Jun 21 10:04:02.770279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 390/729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:02 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1687 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:03.163619 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:03.164304 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:03.170811 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:03.171265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:03.172061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:03.172501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:03.314180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:03.322914 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-258b37aa-fc60-448f-951b-36c6afdab89e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.163540 Jun 21 10:04:03.332929 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 340/730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:03 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:03.786584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:03.787783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:03.794744 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:03.795496 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:03.796311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:03.796753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:04.004811 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:04.013135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-247143fe-9b36-4360-a183-fe98684923fa tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1687 microversion: 2.1 time: 0.231181 Jun 21 10:04:04.014366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 391/731] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:03 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:04.339919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:04.340585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:04.347445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:04.348004 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:04.348858 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:04.349302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:04.353686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:04.486639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:04.494933 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eaab8f3e-a2bb-47c1-9f99-d554043b1191 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.159018 Jun 21 10:04:04.495502 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 341/732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:04 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:05.033646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:05.034463 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:05.042009 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:05.042988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:05.044039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:05.044699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:05.221506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:05.230287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-71515082-7b55-44dd-ab1b-f4a9bb5797b5 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1687 microversion: 2.1 time: 0.202312 Jun 21 10:04:05.231386 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 392/733] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:05 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:05.485303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:05.486724 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:05.497926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:05.498610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:05.499601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:05.500285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:05.515102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:05.516182 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:05.526728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:05.527634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:05.532781 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:05.533685 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:05.581287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1be41148-95bc-4d08-b5e4-0f5bcc4756fd tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/ips" status: 200 len: 149 microversion: 2.1 time: 0.243242 Jun 21 10:04:05.584643 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 342/734] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:04:05 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/ips => generated 149 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:05.836321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:05.855504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fc10cc84-a3c6-4358-a5d3-d8d9045dca42 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.346407 Jun 21 10:04:05.856093 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 393/735] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:05 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:06.250774 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:06.251623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:06.258793 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:06.259241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:06.260054 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:06.260629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:06.296789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-56ca5981-e14f-4d00-8196-6cffdb88090a req-d49d375a-ff94-4fa4-b336-2f7575d0104a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76107a82-b3d2-49da-83fc-a4724bb90252", "tag": "635f5804-9761-428d-8320-8ad2ab5cb2b7"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:06.330918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-56ca5981-e14f-4d00-8196-6cffdb88090a req-d49d375a-ff94-4fa4-b336-2f7575d0104a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:06.331689 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-56ca5981-e14f-4d00-8196-6cffdb88090a req-d49d375a-ff94-4fa4-b336-2f7575d0104a service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:06.356607 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:06.359481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-56ca5981-e14f-4d00-8196-6cffdb88090a req-d49d375a-ff94-4fa4-b336-2f7575d0104a service nova] Creating event network-changed:635f5804-9761-428d-8320-8ad2ab5cb2b7 for instance 76107a82-b3d2-49da-83fc-a4724bb90252 on hv-cinder-80660 Jun 21 10:04:06.370399 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-56ca5981-e14f-4d00-8196-6cffdb88090a req-d49d375a-ff94-4fa4-b336-2f7575d0104a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079803 Jun 21 10:04:06.372612 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 394/736] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:06.374275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-88803a8b-331e-466d-8046-4e15668c7e42 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 200 len: 1620 microversion: 2.1 time: 0.129787 Jun 21 10:04:06.375025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 343/737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:06 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 1620 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:06.569657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-2bd0e29b-8b74-48e5-89e4-54bf13ea624a req-0ffc86c0-92c2-4d01-943a-71984d282aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1006e00-26c8-474c-b97b-8d599dff1cad", "name": "network-vif-deleted", "tag": "fa3d5a86-7393-4180-9232-f187e89bd9ea"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:06.584158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-2bd0e29b-8b74-48e5-89e4-54bf13ea624a req-0ffc86c0-92c2-4d01-943a-71984d282aaf service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:06.587142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-2bd0e29b-8b74-48e5-89e4-54bf13ea624a req-0ffc86c0-92c2-4d01-943a-71984d282aaf service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:06.602567 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-2bd0e29b-8b74-48e5-89e4-54bf13ea624a req-0ffc86c0-92c2-4d01-943a-71984d282aaf service nova] Creating event network-vif-deleted:fa3d5a86-7393-4180-9232-f187e89bd9ea for instance e1006e00-26c8-474c-b97b-8d599dff1cad on hv-cinder-80660 Jun 21 10:04:06.627224 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-2bd0e29b-8b74-48e5-89e4-54bf13ea624a req-0ffc86c0-92c2-4d01-943a-71984d282aaf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062494 Jun 21 10:04:06.628216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 395/738] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:06.873003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:06.874269 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:06.881473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:06.881919 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:06.882679 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:06.883286 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:07.044973 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:07.053586 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-58b4c0d3-7258-4e24-87f6-b1dc91e61414 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.184203 Jun 21 10:04:07.066266 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 344/739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:06 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:07.070988 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fc7f6b7-a8db-4543-9090-71b068402271"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:07.072246 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:07.081045 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:07.081502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:07.082363 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:07.082796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:07.392105 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:07.392903 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: e1006e00-26c8-474c-b97b-8d599dff1cad] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:07.399916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:07.400446 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:07.401333 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:07.401737 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:07.416645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] HTTP exception thrown: Instance e1006e00-26c8-474c-b97b-8d599dff1cad could not be found. Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Request method failure captured: Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad HTTP/1.1 Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZdNDs9Ko7zlYJF7H_bJbHJTVIxnR8iGyhh1iKzgo9tfzm7Svxw-WB014SREFGIM7P_lLu6Ghf31048vHTUBRrYMMQy18C_ZxTbkgL6HgyCBvJyUJ0oOzic6vkfhxAjsVX79jz9W-PUH4Kfyf6NYfDz6HMYI4uevPVz6pwxH6_pbdY Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:07.423671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a80df511c544924a5708de2513bbc42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a80df511c544924a5708de2513bbc42"}]}] Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 7e98533664dd4bf6b90e471fc42ba41f Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance e1006e00-26c8-474c-b97b-8d599dff1cad could not be found. Jun 21 10:04:07.425285 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e1006e00-26c8-474c-b97b-8d599dff1cad'} Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1006e00-26c8-474c-b97b-8d599dff1cad could not be found. Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:07.426166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1006e00-26c8-474c-b97b-8d599dff1cad could not be found. Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1006e00-26c8-474c-b97b-8d599dff1cad could not be found. Jun 21 10:04:07.427573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:07.429721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Returning 404 to user: Instance e1006e00-26c8-474c-b97b-8d599dff1cad could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:07.430932 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-20d903be-3217-4cee-af84-b1f9920cc940 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad" status: 404 len: 111 microversion: 2.1 time: 0.042686 Jun 21 10:04:07.433986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 345/740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:07 2022] GET /compute/v2.1/servers/e1006e00-26c8-474c-b97b-8d599dff1cad => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:04:07.441880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0cf0d9d8-8ac3-4ef7-b9e2-04adef28dee4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '.version_select at 0x7f184ad513a0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:07.460374 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-49111a3a-ffa4-4575-bd4d-733cea80a479 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395474 Jun 21 10:04:07.462333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 396/741] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:04:07 2022] POST /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:07.468249 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0cf0d9d8-8ac3-4ef7-b9e2-04adef28dee4 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-148919559" status: 202 len: 0 microversion: 2.1 time: 0.031020 Jun 21 10:04:07.469136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 346/742] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 10:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-148919559 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:04:08.068529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:08.070037 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=12 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:08.074792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:08.083740 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:08.093796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:08.094815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:08.095906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:08.096611 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:08.323157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:08.331476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a345dc48-4382-47a4-aad6-ff6138e50d9e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.263918 Jun 21 10:04:08.332105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 397/743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:08 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:09.348514 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:09.349660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:09.361095 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:09.361546 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:09.362331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:09.362767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:09.649559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:09.664792 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8cc8f3f0-3bc2-441d-bccc-32edff440a3f tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.317595 Jun 21 10:04:09.664792 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 347/744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:09 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:10.600740 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:10.601349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:10.607900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:10.608412 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:10.609230 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:10.609704 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:10.637520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:04:10.680745 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:10.681444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:10.701070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:10.701614 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:10.702492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:10.703002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:10.723019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-362a0d57-febd-4890-b5dc-c0380b4bcf31 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 204 len: 0 microversion: 2.1 time: 0.126676 Jun 21 10:04:10.724134 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 398/745] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:04:10 2022] DELETE /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:04:10.733514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:10.734377 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:10.743774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:10.745956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:10.746777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:10.747203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:10.895701 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:10.899923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:10.903823 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6c3f6633-5bc5-49f3-b4ba-743a4ca21009 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1507 microversion: 2.1 time: 0.175715 Jun 21 10:04:10.904640 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 399/746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:10 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:10.911327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8fbb1374-1550-44ee-b909-20df073f90eb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.237154 Jun 21 10:04:10.920596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 348/747] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:10 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:11.921207 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:11.922060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:11.930243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:11.930788 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:11.930921 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:11.931060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:11.932192 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:11.932839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:11.937835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:11.938506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:11.939289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:11.939731 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:12.059685 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:12.067220 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed7f86c3-8928-425e-b286-a11a5bca841e tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1507 microversion: 2.1 time: 0.150068 Jun 21 10:04:12.067782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 400/748] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:11 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:12.068243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:12.075693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-71f76abe-65db-441e-954e-7027ae01e0ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.150628 Jun 21 10:04:12.076268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 349/749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:11 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:13.047565 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-abdaf8c3-d525-4476-a8ac-1787fd282b7a req-43ee9660-53da-4250-b464-5cc46727645f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76107a82-b3d2-49da-83fc-a4724bb90252", "name": "network-vif-plugged", "status": "completed", "tag": "635f5804-9761-428d-8320-8ad2ab5cb2b7"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:13.057307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-abdaf8c3-d525-4476-a8ac-1787fd282b7a req-43ee9660-53da-4250-b464-5cc46727645f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:13.057721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-abdaf8c3-d525-4476-a8ac-1787fd282b7a req-43ee9660-53da-4250-b464-5cc46727645f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:13.068811 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-abdaf8c3-d525-4476-a8ac-1787fd282b7a req-43ee9660-53da-4250-b464-5cc46727645f service nova] Creating event network-vif-plugged:635f5804-9761-428d-8320-8ad2ab5cb2b7 for instance 76107a82-b3d2-49da-83fc-a4724bb90252 on hv-cinder-80660 Jun 21 10:04:13.073472 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-abdaf8c3-d525-4476-a8ac-1787fd282b7a req-43ee9660-53da-4250-b464-5cc46727645f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029633 Jun 21 10:04:13.074052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 401/750] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:13.083839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:13.084499 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:13.091310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:13.091911 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:13.093001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:13.093591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:13.097920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:13.098695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:13.107014 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:13.107416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:13.108391 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:13.108938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:13.235530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:13.244300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-47097ddb-ddb8-419e-bd54-c20b42eb13bb tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1507 microversion: 2.1 time: 0.164364 Jun 21 10:04:13.244863 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 350/751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:13 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:13.265574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:13.267893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:13.275335 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a42ec2e8-e4d9-4809-9196-bce171ac39c2 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.186524 Jun 21 10:04:13.275893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 402/752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:13 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:14.083367 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-127c48eb-df3d-4a58-ac19-283538ff3fca req-e5ced3ea-e22a-44bc-aa67-645e286ff302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf0f01-c1f9-42da-8031-85ef8583d52c", "name": "network-vif-deleted", "tag": "88a92e2c-8d38-4158-ac2b-cacf09d1e690"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:14.092219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-127c48eb-df3d-4a58-ac19-283538ff3fca req-e5ced3ea-e22a-44bc-aa67-645e286ff302 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:14.092814 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-127c48eb-df3d-4a58-ac19-283538ff3fca req-e5ced3ea-e22a-44bc-aa67-645e286ff302 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:14.103505 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-127c48eb-df3d-4a58-ac19-283538ff3fca req-e5ced3ea-e22a-44bc-aa67-645e286ff302 service nova] Creating event network-vif-deleted:88a92e2c-8d38-4158-ac2b-cacf09d1e690 for instance 67cf0f01-c1f9-42da-8031-85ef8583d52c on hv-cinder-80660 Jun 21 10:04:14.108500 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-127c48eb-df3d-4a58-ac19-283538ff3fca req-e5ced3ea-e22a-44bc-aa67-645e286ff302 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221128 Jun 21 10:04:14.109075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 351/753] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:14.261278 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:14.261995 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:14.270282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:14.270807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:14.271595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:14.272061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:14.292450 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:14.293335 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:14.299874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:14.300968 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:14.301752 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:14.302261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:14.334112 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:14.341622 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-52d7b8f0-2b70-4a5e-b7e9-f39c137bc217 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1292 microversion: 2.1 time: 0.084204 Jun 21 10:04:14.342187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 403/754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:14 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:14.440013 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:14.447453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fdb7749e-5726-46e4-9531-0e00caf3a412 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1363 microversion: 2.1 time: 0.159741 Jun 21 10:04:14.448023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 352/755] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:14 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:04:15.358371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:15.358986 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:15.365706 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.366160 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.366921 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.367359 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.399908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.400390 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.400838 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lazy-loading 'fault' on Instance uuid 67cf0f01-c1f9-42da-8031-85ef8583d52c {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:04:15.441699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:15.448972 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-32914d36-0143-4c79-a030-ffd3547bec66 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 200 len: 1311 microversion: 2.1 time: 0.094452 Jun 21 10:04:15.449529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 404/756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:15 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:15.464414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:15.465020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:15.471445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.471891 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.472710 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.473143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.597368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:15.604823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1e9a352b-f1bf-4359-b1fe-45401f7504a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1548 microversion: 2.1 time: 0.144208 Jun 21 10:04:15.605406 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 353/757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:15 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1548 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:15.621437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:15.621901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:15.627916 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.628401 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.629726 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:15.630191 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:15.705796 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-20ff1c4d-df0c-4fac-9df7-59820ef991ce tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088159 Jun 21 10:04:15.706411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 405/758] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 10:04:15 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:16.466114 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:16.467345 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 67cf0f01-c1f9-42da-8031-85ef8583d52c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:16.474825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.475535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.476340 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.476779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.490502 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] HTTP exception thrown: Instance 67cf0f01-c1f9-42da-8031-85ef8583d52c could not be found. Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Request method failure captured: Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c HTTP/1.1 Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZdNDs9Ko7zlYJF7H_bJbHJTVIxnR8iGyhh1iKzgo9tfzm7Svxw-WB014SREFGIM7P_lLu6Ghf31048vHTUBRrYMMQy18C_ZxTbkgL6HgyCBvJyUJ0oOzic6vkfhxAjsVX79jz9W-PUH4Kfyf6NYfDz6HMYI4uevPVz6pwxH6_pbdY Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:16.492182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a80df511c544924a5708de2513bbc42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a80df511c544924a5708de2513bbc42"}]}] Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 7e98533664dd4bf6b90e471fc42ba41f Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 67cf0f01-c1f9-42da-8031-85ef8583d52c could not be found. Jun 21 10:04:16.493515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '67cf0f01-c1f9-42da-8031-85ef8583d52c'} Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67cf0f01-c1f9-42da-8031-85ef8583d52c could not be found. Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:16.494253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67cf0f01-c1f9-42da-8031-85ef8583d52c could not be found. Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67cf0f01-c1f9-42da-8031-85ef8583d52c could not be found. Jun 21 10:04:16.495451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:16.496581 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Returning 404 to user: Instance 67cf0f01-c1f9-42da-8031-85ef8583d52c could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:16.496581 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7e8e0f2f-b5e5-4929-907e-a64e3f99126f tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c" status: 404 len: 111 microversion: 2.1 time: 0.031549 Jun 21 10:04:16.502641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:16.503176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:16.506234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 354/759] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:16 2022] GET /compute/v2.1/servers/67cf0f01-c1f9-42da-8031-85ef8583d52c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:16.509545 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.509938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.510707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.511178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.537435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:04:16.624459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-2cdac2be-7f76-448e-8fa8-155edcefe62d req-74d5bd29-baf6-4c64-9b6a-b47ef6916295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76107a82-b3d2-49da-83fc-a4724bb90252", "tag": "635f5804-9761-428d-8320-8ad2ab5cb2b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:16.632103 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ad121386-4fe5-4697-ac82-1060f454dbde tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 204 len: 0 microversion: 2.1 time: 0.133364 Jun 21 10:04:16.633083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 406/760] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:04:16 2022] DELETE /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:04:16.634322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-2cdac2be-7f76-448e-8fa8-155edcefe62d req-74d5bd29-baf6-4c64-9b6a-b47ef6916295 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.634768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-2cdac2be-7f76-448e-8fa8-155edcefe62d req-74d5bd29-baf6-4c64-9b6a-b47ef6916295 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.641885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:16.642581 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:16.647374 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-2cdac2be-7f76-448e-8fa8-155edcefe62d req-74d5bd29-baf6-4c64-9b6a-b47ef6916295 service nova] Creating event network-changed:635f5804-9761-428d-8320-8ad2ab5cb2b7 for instance 76107a82-b3d2-49da-83fc-a4724bb90252 on hv-cinder-80660 Jun 21 10:04:16.649233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.649686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.650455 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:16.650890 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:16.652461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-2cdac2be-7f76-448e-8fa8-155edcefe62d req-74d5bd29-baf6-4c64-9b6a-b47ef6916295 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032287 Jun 21 10:04:16.653107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 355/761] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:16.785198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:16.792603 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-038539a0-ba90-481d-addf-c184f2866f00 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.154921 Jun 21 10:04:16.793160 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 407/762] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:16 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:17.163177 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fc7f6b7-a8db-4543-9090-71b068402271"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:17.164460 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:17.170749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.171275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.172159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.172665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.259312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Invalid volume: volume 4fc7f6b7-a8db-4543-9090-71b068402271 is already attached to instances: 305651e2-488f-4fed-a8d9-2997709c96ea Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: POST /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments HTTP/1.1 Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 74 Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:17.261066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {"volumeAttachment": {"volumeId": "4fc7f6b7-a8db-4543-9090-71b068402271"}} Jun 21 10:04:17.262646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Invalid volume: volume 4fc7f6b7-a8db-4543-9090-71b068402271 is already attached to instances: 305651e2-488f-4fed-a8d9-2997709c96ea Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'server_id': '305651e2-488f-4fed-a8d9-2997709c96ea', 'body': {'volumeAttachment': {'volumeId': '4fc7f6b7-a8db-4543-9090-71b068402271'}}} Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4fc7f6b7-a8db-4543-9090-71b068402271 is already attached to instances: 305651e2-488f-4fed-a8d9-2997709c96ea Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:17.263433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4fc7f6b7-a8db-4543-9090-71b068402271 is already attached to instances: 305651e2-488f-4fed-a8d9-2997709c96ea Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:17.264762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4fc7f6b7-a8db-4543-9090-71b068402271 is already attached to instances: 305651e2-488f-4fed-a8d9-2997709c96ea Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 400 to user: Invalid volume: volume 4fc7f6b7-a8db-4543-9090-71b068402271 is already attached to instances: 305651e2-488f-4fed-a8d9-2997709c96ea {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d2f55796-628d-44e7-b16d-1216d5ed82da tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103797 Jun 21 10:04:17.266153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 356/763] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:04:17 2022] POST /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:04:17.322681 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:17.323168 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:17.329211 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.329658 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.330426 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.330864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.413017 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lazy-loading 'services' on Instance uuid 305651e2-488f-4fed-a8d9-2997709c96ea {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:04:17.487105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-51045283-805b-4f18-b956-79b87d19a256 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments/4fc7f6b7-a8db-4543-9090-71b068402271" status: 202 len: 0 microversion: 2.1 time: 0.168115 Jun 21 10:04:17.490026 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 408/764] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:04:17 2022] DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments/4fc7f6b7-a8db-4543-9090-71b068402271 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:04:17.498232 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:17.499210 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:17.506912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.507371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.508178 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.508628 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.540772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3e614088-b0a2-4910-9277-88667e4b712f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Jun 21 10:04:17.541513 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 357/765] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:17 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:17.811200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:17.811896 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:17.818148 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.818598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.819362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:17.819803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:17.947837 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:17.955233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0a5d821a-620a-41a2-9f91-63f3cdfd2196 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.148738 Jun 21 10:04:17.955798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 409/766] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:17 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:18.552821 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:18.553809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:18.560246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:18.560695 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:18.561444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:18.561876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:18.591057 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b3b657b2-ae29-4fc1-b3c0-faaef91f74fc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042693 Jun 21 10:04:18.591590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 358/767] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:18 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:18.972353 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:18.973482 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:18.980111 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:18.980564 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:18.981326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:18.981768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:19.111794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:19.120058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1450de1e-cf01-4dc0-83f8-056204ee12b8 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.151541 Jun 21 10:04:19.120615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 410/768] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:18 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:19.603258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:19.604204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:19.610658 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:19.611101 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:19.611854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:19.612322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:19.640762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-04bc7056-29b7-49d9-b383-0fcab25466bf tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Jun 21 10:04:19.641301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 359/769] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:19 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:20.136643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:20.137248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:20.143868 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:20.144348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:20.145619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:20.146051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:20.271298 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:20.278682 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed1b2732-44e8-440b-a354-fd39cdcf56dc tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1520 microversion: 2.1 time: 0.145857 Jun 21 10:04:20.279240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 411/770] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:20 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:20.652460 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:20.653748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:20.660658 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:20.661108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:20.661880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:20.662311 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:20.696484 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-36010799-38c9-4441-a236-1c89b333cc4b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Jun 21 10:04:20.697250 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 360/771] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:20 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:21.110316 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-9b446478-7495-460b-97ec-4308658d0804 req-aa07e840-514c-48a6-a03f-cf1c8b2ccd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f81dd1c-df4e-45e0-963a-9384e494395e", "name": "network-vif-deleted", "tag": "b0d9edc0-6f2a-4930-aba3-8a357b12ebca"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:21.122178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9b446478-7495-460b-97ec-4308658d0804 req-aa07e840-514c-48a6-a03f-cf1c8b2ccd40 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.122634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9b446478-7495-460b-97ec-4308658d0804 req-aa07e840-514c-48a6-a03f-cf1c8b2ccd40 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.138190 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-9b446478-7495-460b-97ec-4308658d0804 req-aa07e840-514c-48a6-a03f-cf1c8b2ccd40 service nova] Creating event network-vif-deleted:b0d9edc0-6f2a-4930-aba3-8a357b12ebca for instance 5f81dd1c-df4e-45e0-963a-9384e494395e on hv-cinder-80660 Jun 21 10:04:21.144055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-9b446478-7495-460b-97ec-4308658d0804 req-aa07e840-514c-48a6-a03f-cf1c8b2ccd40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038333 Jun 21 10:04:21.145512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 412/772] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:21.295726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:21.296382 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:21.303141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.303592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.304410 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.304853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.335324 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.335707 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.336228 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lazy-loading 'fault' on Instance uuid 5f81dd1c-df4e-45e0-963a-9384e494395e {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:04:21.340084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:21.379743 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e98533664dd4bf6b90e471fc42ba41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a80df511c544924a5708de2513bbc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:21.387038 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-44d4fb1c-4f5c-4d9b-96e0-b0298a245329 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 200 len: 1310 microversion: 2.1 time: 0.095299 Jun 21 10:04:21.387590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 361/773] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:21 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:21.709890 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:21.710894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:21.717686 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.718133 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.718903 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.719349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.748977 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-da0de62c-f4a1-446c-8347-472f1191ec2e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043904 Jun 21 10:04:21.749529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 413/774] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:04:21 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:04:21.810691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:21.811212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:21.817636 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.818119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.818846 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.819277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.844700 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:04:21.917005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9cd11297-7975-42c4-b528-32356a4ac6e4 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 204 len: 0 microversion: 2.1 time: 0.109821 Jun 21 10:04:21.917769 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 362/775] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:04:21 2022] DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:04:21.926045 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:21.926584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:21.932634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.933084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:21.933848 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:21.934285 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:22.059119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:22.067084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4fdb639b-5bfa-4a68-ad20-abaec2b23251 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1681 microversion: 2.1 time: 0.144566 Jun 21 10:04:22.067634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 414/776] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:21 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:22.404263 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:22.404963 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] [instance: 5f81dd1c-df4e-45e0-963a-9384e494395e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:22.410938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:22.411387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:22.412176 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:22.412622 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:22.425610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] HTTP exception thrown: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e could not be found. Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Request method failure captured: Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e HTTP/1.1 Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZdNDs9Ko7zlYJF7H_bJbHJTVIxnR8iGyhh1iKzgo9tfzm7Svxw-WB014SREFGIM7P_lLu6Ghf31048vHTUBRrYMMQy18C_ZxTbkgL6HgyCBvJyUJ0oOzic6vkfhxAjsVX79jz9W-PUH4Kfyf6NYfDz6HMYI4uevPVz6pwxH6_pbdY Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:22.427660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a80df511c544924a5708de2513bbc42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a80df511c544924a5708de2513bbc42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a80df511c544924a5708de2513bbc42"}]}] Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 7a80df511c544924a5708de2513bbc42 Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808320288 Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 7e98533664dd4bf6b90e471fc42ba41f Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808320288-project Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e could not be found. Jun 21 10:04:22.429248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '5f81dd1c-df4e-45e0-963a-9384e494395e'} Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e could not be found. Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:22.430270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e could not be found. Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e could not be found. Jun 21 10:04:22.431727 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:22.433418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] Returning 404 to user: Instance 5f81dd1c-df4e-45e0-963a-9384e494395e could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:22.433418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5715de3d-f9b8-4225-8c82-94e79cbcfe87 tempest-ServerRescueNegativeTestJSON-808320288 tempest-ServerRescueNegativeTestJSON-808320288-project] 10.222.0.36 "GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e" status: 404 len: 111 microversion: 2.1 time: 0.029114 Jun 21 10:04:22.433418 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 363/777] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:22 2022] GET /compute/v2.1/servers/5f81dd1c-df4e-45e0-963a-9384e494395e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:23.084223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:23.084839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:23.088266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:23.092511 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:23.093164 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:23.093957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:23.094396 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:23.303523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:23.311085 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c7026699-8cc0-45dc-9c91-8202c87d5a96 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1681 microversion: 2.1 time: 0.230861 Jun 21 10:04:23.311637 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 415/778] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:23 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:24.329585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:24.330207 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:24.337519 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:24.338002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:24.338953 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:24.339392 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:24.478733 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:24.485874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d1e1fef5-b2a0-4706-a0b4-12d801494cda tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1681 microversion: 2.1 time: 0.160801 Jun 21 10:04:24.486430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 364/779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:24 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:25.505079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:25.506699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:25.520274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:25.521161 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:25.522343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:25.522994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:25.563673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-5a35e072-1f01-4136-8d7d-8752f8925912 req-ef5b7ca2-7661-4b80-bb2a-9e52e4b8c948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305651e2-488f-4fed-a8d9-2997709c96ea", "name": "network-vif-deleted", "tag": "edef25d3-094d-46dc-a85b-388645403cbd"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:25.585798 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-5a35e072-1f01-4136-8d7d-8752f8925912 req-ef5b7ca2-7661-4b80-bb2a-9e52e4b8c948 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:25.586672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-5a35e072-1f01-4136-8d7d-8752f8925912 req-ef5b7ca2-7661-4b80-bb2a-9e52e4b8c948 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:25.601235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-5a35e072-1f01-4136-8d7d-8752f8925912 req-ef5b7ca2-7661-4b80-bb2a-9e52e4b8c948 service nova] Creating event network-vif-deleted:edef25d3-094d-46dc-a85b-388645403cbd for instance 305651e2-488f-4fed-a8d9-2997709c96ea on hv-cinder-80660 Jun 21 10:04:25.606673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-5a35e072-1f01-4136-8d7d-8752f8925912 req-ef5b7ca2-7661-4b80-bb2a-9e52e4b8c948 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048759 Jun 21 10:04:25.607454 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 365/780] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:25.664327 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:25.681238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-14f5b72a-a8a0-46d5-94b8-9d55a6ad16cb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 200 len: 1614 microversion: 2.1 time: 0.182091 Jun 21 10:04:25.682942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 416/781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:25 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 1614 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:26.701124 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:26.701837 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:26.711088 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:26.711709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:26.712533 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:26.712969 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:26.736685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea HTTP/1.1 Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:26.739303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:04:26.741118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '305651e2-488f-4fed-a8d9-2997709c96ea'} Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:26.741981 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:04:26.743191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:26.744501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:26.744501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ae2913f1-5bc7-4ae7-a4b1-8bb9f71d0360 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 404 len: 111 microversion: 2.1 time: 0.045078 Jun 21 10:04:26.744501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 366/782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:26 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:26.750643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b7853d37-7489-41ea-ad73-f2947de51eae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '.version_select at 0x7f184aafcd30>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:26.770593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b7853d37-7489-41ea-ad73-f2947de51eae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920405297" status: 202 len: 0 microversion: 2.1 time: 0.023862 Jun 21 10:04:26.771171 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 417/783] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 10:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920405297 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:04:27.462645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5e18e8aa-1a84-45b9-8cd3-71849ad1b08a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: .version_select at 0x7f184ab6b8b0>, body: {"keypair": {"name": "tempest-keypair-119250998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl35Zr3wZ4S0j1Od8BsarBWK5txKd+Efn96M8h20thG0PfebO3gILfRQsMcXmc82iie1QT21nNpg/2vuVQLVGo8LJBCr5XkW48wnk+44i2czwpp6nj870oZh7obivOXIA=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:27.477132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-5e18e8aa-1a84-45b9-8cd3-71849ad1b08a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:04:27.480988 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-5e18e8aa-1a84-45b9-8cd3-71849ad1b08a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:04:27.503174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5e18e8aa-1a84-45b9-8cd3-71849ad1b08a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044259 Jun 21 10:04:27.503790 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 367/784] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:04:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:28.080373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0eff92cf-8c04-4417-86f0-6a761ddb75de tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Action: 'create', calling method: .version_select at 0x7f18534d3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1251324468"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:28.400972 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0eff92cf-8c04-4417-86f0-6a761ddb75de tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.446933 Jun 21 10:04:28.408721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 418/785] 10.222.0.36 () {60 vars in 1154 bytes} [Tue Jun 21 10:04:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 449 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 10:04:28.414495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-29915177-5e7d-447d-9b37-857ecc80dc16 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184ab731f0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:28.465865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-29915177-5e7d-447d-9b37-857ecc80dc16 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 200 len: 345 microversion: 2.1 time: 0.056451 Jun 21 10:04:28.466509 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 368/786] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:04:28 2022] GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:28.837797 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1655096782", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c994f52e-02e2-4742-8c3a-a41ee59b94bd"}], "security_groups": [{"name": "tempest-securitygroup--770631949"}], "key_name": "tempest-keypair-119250998", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:28.937909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] validate_networks() for [('c994f52e-02e2-4742-8c3a-a41ee59b94bd', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:04:29.386088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:04:29.386669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:04:29.386960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:04:29.387367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:04:29.387776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:04:29.396403 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:29.396846 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:29.397629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:29.398058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:29.416915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:04:29.420786 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Getting quotas for user d3d76c556b5f41f19c1a2a466a031cdf and project 1a5852acb729432e89c68955c8ed5e8b. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:04:29.432151 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:04:29.434385 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:04:29.478497 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0a10d9be-9f2c-4a65-9084-04f29a72c4f8 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644930 Jun 21 10:04:29.479284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 419/787] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:04:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:04:29.480725 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-26cb8be6-3159-4672-bbc1-5d1e097cccda tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184ab06820>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:29.489393 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bc757c60-9ea6-4b00-9c4e-dd08caee9569 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:29.490258 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bc757c60-9ea6-4b00-9c4e-dd08caee9569 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:29.533578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-26cb8be6-3159-4672-bbc1-5d1e097cccda tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 200 len: 346 microversion: 2.1 time: 0.058579 Jun 21 10:04:29.534175 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 369/788] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:04:29 2022] GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:29.548021 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b807a95f-16ca-4929-97de-1d7d0e7d6483 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Action: 'create', calling method: .version_select at 0x7f184ab33dc0>, body: {"snapshot": {"volume_id": "a4aca06c-9299-4b58-960a-9a75cc6ebd34", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-454596057"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:29.554315 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bc757c60-9ea6-4b00-9c4e-dd08caee9569 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:29.561166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bc757c60-9ea6-4b00-9c4e-dd08caee9569 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1241 microversion: 2.1 time: 0.076188 Jun 21 10:04:29.561720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 420/789] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:29 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:04:29.711615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b807a95f-16ca-4929-97de-1d7d0e7d6483 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.169222 Jun 21 10:04:29.712952 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 370/790] 10.222.0.36 () {60 vars in 1161 bytes} [Tue Jun 21 10:04:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:29.723334 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8ea82362-d8a6-4e83-9e0c-1c651d4e0151 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f18534d3160>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:29.753221 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8ea82362-d8a6-4e83-9e0c-1c651d4e0151 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 200 len: 286 microversion: 2.1 time: 0.034285 Jun 21 10:04:29.753811 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 421/791] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:29 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:29.763236 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fbe6555a-a546-43f3-87d0-c60a5fc8feaa tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184ab56dc0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:29.793012 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fbe6555a-a546-43f3-87d0-c60a5fc8feaa tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033420 Jun 21 10:04:29.793672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 371/792] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jun 21 10:04:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:29.804095 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-deead7e2-17a0-4eda-91f1-7c077595e496 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f18534f8b80>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:29.992718 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-deead7e2-17a0-4eda-91f1-7c077595e496 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 200 len: 286 microversion: 2.1 time: 0.192878 Jun 21 10:04:29.993274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 422/793] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:29 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:30.578298 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:30.578942 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:30.585525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:30.585973 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:30.586735 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:30.587171 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:30.649322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:30.656789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6da37a94-d4fd-4c44-b679-dbb7fbbbaa47 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1237 microversion: 2.1 time: 0.082763 Jun 21 10:04:30.657344 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 372/794] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:30 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:31.005214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-acb53e03-5a1a-47f3-9a73-02b62d99312d tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184aafcaf0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:31.033599 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-acb53e03-5a1a-47f3-9a73-02b62d99312d tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 200 len: 286 microversion: 2.1 time: 0.032626 Jun 21 10:04:31.034270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 423/795] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:30 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:31.673637 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:31.674246 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:31.680726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:31.681168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:31.681920 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:31.682351 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:31.741675 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:31.748801 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-52287b6c-0225-4da4-a08c-7860341c4197 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1293 microversion: 2.1 time: 0.079072 Jun 21 10:04:31.749345 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 373/796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:31 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:32.046436 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-06935386-d6a3-40bf-a2b2-5f0388d3cafd tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f18534f81f0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:32.076509 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-06935386-d6a3-40bf-a2b2-5f0388d3cafd tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 200 len: 286 microversion: 2.1 time: 0.034248 Jun 21 10:04:32.077042 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 424/797] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:32 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:32.765144 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:32.765759 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:32.768289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:32.774169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:32.774624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:32.775385 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:32.775820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:32.837686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:32.845093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-261d3ca6-6296-4381-8ecd-e82a02c3a4cc tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1293 microversion: 2.1 time: 0.083769 Jun 21 10:04:32.845651 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 374/798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:32 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:33.089311 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3593bd51-77d6-4f14-a66b-e0acca5cd86c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f18534d3e50>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:33.123466 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3593bd51-77d6-4f14-a66b-e0acca5cd86c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 200 len: 287 microversion: 2.1 time: 0.038512 Jun 21 10:04:33.124035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 425/799] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:33 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:33.134667 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-46a6ca53-36c6-4103-b98b-018a59d86b60 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184ab73430>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:33.201932 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-46a6ca53-36c6-4103-b98b-018a59d86b60 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 202 len: 0 microversion: 2.1 time: 0.071118 Jun 21 10:04:33.202569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 375/800] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Jun 21 10:04:33 2022] DELETE /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:04:33.211457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ec2658e7-2db0-45b8-8e57-ca56c6ba04b8 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f18534d3160>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:33.241127 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ec2658e7-2db0-45b8-8e57-ca56c6ba04b8 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 200 len: 286 microversion: 2.1 time: 0.034318 Jun 21 10:04:33.245090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 426/801] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:33 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:33.862640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:33.863247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:33.870194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:33.870629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:33.871424 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:33.871858 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:34.253730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3bef64b0-8c43-4649-af42-216172f71f88 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f18534f8430>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:34.256272 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:34.270262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ed55381b-3cb3-4b70-89ae-78bfdd131020 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1366 microversion: 2.1 time: 0.411828 Jun 21 10:04:34.273219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 376/802] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:33 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:34.292746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-3bef64b0-8c43-4649-af42-216172f71f88 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] HTTP exception thrown: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3bef64b0-8c43-4649-af42-216172f71f88 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Request method failure captured: Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 HTTP/1.1 Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZer3C8k6vjycuGum-UWM8hJZflfBcdb-43_c0U3GY0UVdH3CVWqE0Vi_wLbxAzfCdLp3yJWHpgISi2j68t4NEKqq9ZYKO2uBv1IXq1T5_kkBSoW_0CsNyW11oaBpGvd-H22dszVzsQjOm3mmgKJS68qQ6w0elEFwM_2OpKvtkD46Cc Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:04:34.296189 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_93f361e33f094371b177c5872b9506b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/93f361e33f094371b177c5872b9506b5"}]}] Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 7071b67884f6466b9378ea25407f9d72 Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'da3154c3-1a06-43c0-a350-48468c89b203'} Jun 21 10:04:34.297776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. (HTTP 404) (Request-ID: req-deebf9d1-f5b3-4a0a-baa9-6eedd2dfc2b6) Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.298762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:04:34.300231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 10:04:34.302498 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3bef64b0-8c43-4649-af42-216172f71f88 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Returning 404 to user: Snapshot da3154c3-1a06-43c0-a350-48468c89b203 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:34.305015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3bef64b0-8c43-4649-af42-216172f71f88 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203" status: 404 len: 111 microversion: 2.1 time: 0.053214 Jun 21 10:04:34.305971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 427/803] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:04:34 2022] GET /compute/v2.1/os-snapshots/da3154c3-1a06-43c0-a350-48468c89b203 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:34.312038 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ca60621a-29a5-4315-84de-0fc92a306ed6 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184ab33310>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:34.379138 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ca60621a-29a5-4315-84de-0fc92a306ed6 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 202 len: 0 microversion: 2.1 time: 0.070822 Jun 21 10:04:34.380186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 377/804] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:04:34 2022] DELETE /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:04:34.388049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a77fd67b-0672-4411-adaa-9a925e2308a9 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184aaf6dc0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:34.467520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a77fd67b-0672-4411-adaa-9a925e2308a9 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 200 len: 345 microversion: 2.1 time: 0.083126 Jun 21 10:04:34.472810 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 428/805] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:04:34 2022] GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:34.511107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-878e8ed8-e8bd-4ab2-a346-1f2982c32287 req-e78d72e1-6cc6-44b0-a62d-11620fb1f40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9ddc0d-061c-4316-b73d-2769962f85de", "tag": "df3cbd27-169f-43f7-934e-031db914b7cb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:34.519495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-878e8ed8-e8bd-4ab2-a346-1f2982c32287 req-e78d72e1-6cc6-44b0-a62d-11620fb1f40e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:34.520505 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-878e8ed8-e8bd-4ab2-a346-1f2982c32287 req-e78d72e1-6cc6-44b0-a62d-11620fb1f40e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:34.531927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-878e8ed8-e8bd-4ab2-a346-1f2982c32287 req-e78d72e1-6cc6-44b0-a62d-11620fb1f40e service nova] Creating event network-changed:df3cbd27-169f-43f7-934e-031db914b7cb for instance 4b9ddc0d-061c-4316-b73d-2769962f85de on hv-cinder-80660 Jun 21 10:04:34.539192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-878e8ed8-e8bd-4ab2-a346-1f2982c32287 req-e78d72e1-6cc6-44b0-a62d-11620fb1f40e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137062 Jun 21 10:04:34.539804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 378/806] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:35.288330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:35.288937 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:35.295505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:35.295949 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:35.296735 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:35.297170 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:35.311554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:35.425463 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:35.433294 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d2e992fe-727b-4799-82f0-77293e08e784 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1366 microversion: 2.1 time: 0.149229 Jun 21 10:04:35.433831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 429/807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:35 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:35.480990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-90b1a490-54b5-441f-8f4f-9f39e16769e5 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184ab36310>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:35.508471 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-90b1a490-54b5-441f-8f4f-9f39e16769e5 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] HTTP exception thrown: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-90b1a490-54b5-441f-8f4f-9f39e16769e5 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Request method failure captured: Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 HTTP/1.1 Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZer3C8k6vjycuGum-UWM8hJZflfBcdb-43_c0U3GY0UVdH3CVWqE0Vi_wLbxAzfCdLp3yJWHpgISi2j68t4NEKqq9ZYKO2uBv1IXq1T5_kkBSoW_0CsNyW11oaBpGvd-H22dszVzsQjOm3mmgKJS68qQ6w0elEFwM_2OpKvtkD46Cc Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:35.511722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_93f361e33f094371b177c5872b9506b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/93f361e33f094371b177c5872b9506b5"}]}] Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 7071b67884f6466b9378ea25407f9d72 Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'a4aca06c-9299-4b58-960a-9a75cc6ebd34'} Jun 21 10:04:35.513315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. (HTTP 404) (Request-ID: req-920bb67e-c36a-4b9c-b1b7-fa17d2b86c82) Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.514289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:04:35.515647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:04:35.516885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-90b1a490-54b5-441f-8f4f-9f39e16769e5 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Returning 404 to user: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-90b1a490-54b5-441f-8f4f-9f39e16769e5 tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 404 len: 109 microversion: 2.1 time: 0.036798 Jun 21 10:04:35.518173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 379/808] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:04:35 2022] GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:35.526813 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-acd17bb6-449f-4558-b709-552561d0d55a tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184aaf63a0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:35.554329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-acd17bb6-449f-4558-b709-552561d0d55a tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] HTTP exception thrown: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-acd17bb6-449f-4558-b709-552561d0d55a tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Request method failure captured: Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 HTTP/1.1 Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZer3C8k6vjycuGum-UWM8hJZflfBcdb-43_c0U3GY0UVdH3CVWqE0Vi_wLbxAzfCdLp3yJWHpgISi2j68t4NEKqq9ZYKO2uBv1IXq1T5_kkBSoW_0CsNyW11oaBpGvd-H22dszVzsQjOm3mmgKJS68qQ6w0elEFwM_2OpKvtkD46Cc Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:04:35.556635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_93f361e33f094371b177c5872b9506b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/93f361e33f094371b177c5872b9506b5"}]}] Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 7071b67884f6466b9378ea25407f9d72 Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'a4aca06c-9299-4b58-960a-9a75cc6ebd34'} Jun 21 10:04:35.558157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. (HTTP 404) (Request-ID: req-f39e35ea-80ef-4809-8663-efeef7fd668b) Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.559229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:04:35.560655 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 10:04:35.562102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-acd17bb6-449f-4558-b709-552561d0d55a tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Returning 404 to user: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-acd17bb6-449f-4558-b709-552561d0d55a tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 404 len: 109 microversion: 2.1 time: 0.034967 Jun 21 10:04:35.563444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 430/809] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:04:35 2022] DELETE /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:35.566386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fc21b0f1-567f-45fb-b6a4-40bef0e9428c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Calling method '.version_select at 0x7f184aabeca0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:35.593274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-fc21b0f1-567f-45fb-b6a4-40bef0e9428c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] HTTP exception thrown: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fc21b0f1-567f-45fb-b6a4-40bef0e9428c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Request method failure captured: Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 HTTP/1.1 Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZer3C8k6vjycuGum-UWM8hJZflfBcdb-43_c0U3GY0UVdH3CVWqE0Vi_wLbxAzfCdLp3yJWHpgISi2j68t4NEKqq9ZYKO2uBv1IXq1T5_kkBSoW_0CsNyW11oaBpGvd-H22dszVzsQjOm3mmgKJS68qQ6w0elEFwM_2OpKvtkD46Cc Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:04:35.595222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_93f361e33f094371b177c5872b9506b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/93f361e33f094371b177c5872b9506b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/93f361e33f094371b177c5872b9506b5"}]}] Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 93f361e33f094371b177c5872b9506b5 Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1698256617 Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 7071b67884f6466b9378ea25407f9d72 Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1698256617-project Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'a4aca06c-9299-4b58-960a-9a75cc6ebd34'} Jun 21 10:04:35.596809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. (HTTP 404) (Request-ID: req-5cb7380a-54a7-4df6-9629-b714ce697ad1) Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.598379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:04:35.599819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:04:35.601273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fc21b0f1-567f-45fb-b6a4-40bef0e9428c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] Returning 404 to user: Volume a4aca06c-9299-4b58-960a-9a75cc6ebd34 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fc21b0f1-567f-45fb-b6a4-40bef0e9428c tempest-VolumesSnapshotsTestJSON-1698256617 tempest-VolumesSnapshotsTestJSON-1698256617-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34" status: 404 len: 109 microversion: 2.1 time: 0.034149 Jun 21 10:04:35.602812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 380/810] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:04:35 2022] GET /compute/v2.1/os-volumes/a4aca06c-9299-4b58-960a-9a75cc6ebd34 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:36.449880 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:36.450485 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:36.457876 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:36.458273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:36.459042 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:36.459480 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:36.592664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:36.599948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-275c5d23-b48a-4256-8214-beb136359a6e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1366 microversion: 2.1 time: 0.154434 Jun 21 10:04:36.600522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 431/811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:36 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:37.616824 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:37.618142 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:37.620852 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:37.631096 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:37.632194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:37.633157 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:37.633803 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:37.770867 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:37.778534 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ea3fbbbc-c796-4ee7-bb37-c1e853baef29 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1366 microversion: 2.1 time: 0.165727 Jun 21 10:04:37.779092 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 381/812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:37 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:38.795297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:38.795903 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:38.802345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:38.802804 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:38.803556 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:38.804013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:38.926429 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:38.933764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f1b3b240-159e-4707-9b5c-65096a05271a tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1366 microversion: 2.1 time: 0.142377 Jun 21 10:04:38.934312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 432/813] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:38 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:39.315612 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-26e8f006-3b72-4c46-b856-a9346b847c2c req-b5c5338d-1af9-4ddc-80b2-c731927d72fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9ddc0d-061c-4316-b73d-2769962f85de", "name": "network-vif-plugged", "status": "completed", "tag": "df3cbd27-169f-43f7-934e-031db914b7cb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:39.324258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-26e8f006-3b72-4c46-b856-a9346b847c2c req-b5c5338d-1af9-4ddc-80b2-c731927d72fa service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:39.324696 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-26e8f006-3b72-4c46-b856-a9346b847c2c req-b5c5338d-1af9-4ddc-80b2-c731927d72fa service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:39.336010 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-26e8f006-3b72-4c46-b856-a9346b847c2c req-b5c5338d-1af9-4ddc-80b2-c731927d72fa service nova] Creating event network-vif-plugged:df3cbd27-169f-43f7-934e-031db914b7cb for instance 4b9ddc0d-061c-4316-b73d-2769962f85de on hv-cinder-80660 Jun 21 10:04:39.340754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-26e8f006-3b72-4c46-b856-a9346b847c2c req-b5c5338d-1af9-4ddc-80b2-c731927d72fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157733 Jun 21 10:04:39.341345 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 382/814] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:39.949431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:39.949996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:39.951885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:39.952580 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=8 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:39.959321 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:39.959770 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:39.960549 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:39.961001 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:40.086395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:40.093880 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b8eb5590-cdb2-4e6b-b55b-cd3b8b81dd63 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1366 microversion: 2.1 time: 0.148312 Jun 21 10:04:40.094435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 433/815] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:39 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:41.113995 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:41.113995 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:41.119932 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:41.120408 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:41.121174 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:41.121612 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:41.258701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:41.266569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-81600335-adee-49ac-b852-506ab42c7a2b tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1556 microversion: 2.1 time: 0.159550 Jun 21 10:04:41.267128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 383/816] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:04:41 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:04:41.283070 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:41.283566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:41.290373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:41.290994 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:41.291843 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:41.292748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:41.375782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-501c1777-b101-4d44-aba4-47685409d066 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096563 Jun 21 10:04:41.376395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 434/817] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 21 10:04:41 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:42.762549 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-66e637b7-0991-496d-8def-4c33b47a210f req-b74273f6-20ed-4156-a3de-052b33b6643e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9ddc0d-061c-4316-b73d-2769962f85de", "tag": "df3cbd27-169f-43f7-934e-031db914b7cb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:42.773332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-66e637b7-0991-496d-8def-4c33b47a210f req-b74273f6-20ed-4156-a3de-052b33b6643e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:42.774100 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-66e637b7-0991-496d-8def-4c33b47a210f req-b74273f6-20ed-4156-a3de-052b33b6643e service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:42.792310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-66e637b7-0991-496d-8def-4c33b47a210f req-b74273f6-20ed-4156-a3de-052b33b6643e service nova] Creating event network-changed:df3cbd27-169f-43f7-934e-031db914b7cb for instance 4b9ddc0d-061c-4316-b73d-2769962f85de on hv-cinder-80660 Jun 21 10:04:42.798125 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-66e637b7-0991-496d-8def-4c33b47a210f req-b74273f6-20ed-4156-a3de-052b33b6643e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039095 Jun 21 10:04:42.799292 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 384/818] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:04:43.524648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:43.525873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:43.532097 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:43.532548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:43.533344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:43.533782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:43.559657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-686c848a-be84-4d63-b0c4-15ff93f95e3f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/ips" status: 200 len: 152 microversion: 2.20 time: 0.333619 Jun 21 10:04:43.565575 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 435/819] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jun 21 10:04:43 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/ips => generated 152 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:04:45.685381 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:45.686001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:45.692261 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:45.693229 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:45.693997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:45.694432 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:45.716716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lazy-loading 'flavor' on Instance uuid e013028d-603c-49de-ad9f-d8f583b1b516 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:04:45.977432 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-502571b8-2183-4f26-b3f7-a2ebcfd72f12 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/action" status: 202 len: 0 microversion: 2.20 time: 0.296768 Jun 21 10:04:45.978070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 385/820] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 10:04:45 2022] POST /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:04:45.986499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:45.987109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:45.994885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:45.995637 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:45.996575 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:45.997006 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:46.134308 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:46.142437 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:46.144089 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:46.145142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7a48ab24-0cee-4fb5-a917-9e1e7cb19da7 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.162887 Jun 21 10:04:46.145678 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 436/821] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:45 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:47.164201 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:47.165039 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:47.171504 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:47.172075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:47.172920 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:47.173436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:47.304703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:47.313146 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:47.314721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:47.315889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f1296ab2-7c1a-4676-80a7-93d195634782 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.156657 Jun 21 10:04:47.327859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 386/822] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:47 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:48.335166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:48.335863 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:48.342478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:48.343000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:48.343839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:48.344365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:48.535144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:48.543242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:48.544789 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:48.545963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c9c9890f-d5dc-446f-9b01-7112db53061c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.215239 Jun 21 10:04:48.546513 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 437/823] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:48 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:49.564552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:49.565186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:49.572544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:49.573012 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:49.573771 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:49.574230 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:49.593262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:49.709528 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:49.717445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:49.718938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:49.720115 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7d4bc23d-c452-455b-b84a-a9ed096b8b06 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.159413 Jun 21 10:04:49.720665 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 387/824] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:49 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:50.737551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:50.738170 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:50.745745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:50.746250 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:50.746964 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:50.747458 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:50.882083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:50.889904 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:50.891377 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:50.892559 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e4712a61-9f33-4eec-9db5-61c1a2977d9a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.158868 Jun 21 10:04:50.893103 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 438/825] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:50 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:51.910294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:51.910897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:51.917346 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:51.917783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:51.918530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:51.918957 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:52.047415 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:52.055235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:52.056763 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:52.057909 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-015bbd66-b1e6-4e09-96fc-74ea818909cb tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.151465 Jun 21 10:04:52.058446 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 388/826] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:51 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:52.646629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:52.647195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:52.653592 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:52.654037 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:52.654795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:52.655232 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:52.678603 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9ee03f32-e061-47c1-bd8b-319b80706a2a tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/ips" status: 200 len: 145 microversion: 2.1 time: 0.035801 Jun 21 10:04:52.679184 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 439/827] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:04:52 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:53.075704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:53.076381 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:53.082970 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:53.083421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:53.084226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:53.084668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:53.215480 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:53.223329 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:53.224868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:53.226019 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f8c0de58-f76a-4baa-a681-313852e8686b tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.154201 Jun 21 10:04:53.226577 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 389/828] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:53 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:53.993079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb553bee-9a3f-432f-8430-94f2de6e8707"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:04:53.994195 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:53.999355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:54.001214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:54.001691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:54.002467 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:54.002894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:54.250467 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:54.251081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:54.261043 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:54.261523 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:54.262419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:54.263617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:54.276218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-142178a9-a66e-4a39-8d45-ad536d7dd00e tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287167 Jun 21 10:04:54.277260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 440/829] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:04:53 2022] POST /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:04:54.403601 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:54.412324 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:54.413895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:54.415147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-be8118b7-9411-4e50-aa02-44aaa3be1d04 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.173248 Jun 21 10:04:54.415744 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 390/830] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:54 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:55.434485 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:55.435180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:55.441328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:55.441779 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:55.442542 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:55.442979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:55.572330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:55.581472 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:55.583811 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:55.585744 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5d12cad1-ebdb-41da-ae83-178618d7f8fd tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.155909 Jun 21 10:04:55.586302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 441/831] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:55 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:56.604725 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:56.605331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:56.611927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:56.612388 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:56.613816 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:56.614262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:56.747364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:56.755571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:56.757114 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:56.758277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-414201a7-6b5c-4fc6-93e4-36c5a558a229 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.157476 Jun 21 10:04:56.758884 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 391/832] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:56 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:57.776814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:57.777421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:57.784029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:57.784568 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:57.785478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:57.786061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:57.918509 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:57.927415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:57.928960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:57.930178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d4298250-e56e-4895-9cbc-f19f33ad847d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.157179 Jun 21 10:04:57.930729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 442/833] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:57 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:04:58.948991 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:04:58.949518 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:04:58.956073 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:58.956520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:58.957268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:04:58.957723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:04:59.086755 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:59.094673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:59.096194 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:04:59.097346 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fe64c998-a68b-4b2a-913e-7c3b194caac0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.152285 Jun 21 10:04:59.097892 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 392/834] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:04:58 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:00.116783 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:00.117402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:00.124005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:00.124475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:00.125268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:00.125710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:00.256786 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:00.264681 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:00.266173 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:00.267333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-50a031f3-a587-42ae-b720-7db20af9cb31 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.155756 Jun 21 10:05:00.267893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 443/835] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:00 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:01.285805 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:01.286918 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:01.293535 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:01.293986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:01.294751 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:01.295192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:01.419772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:01.427752 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:01.429334 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:01.430492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-77be1092-327e-4f5d-8583-6f24d8924ed6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.148761 Jun 21 10:05:01.431042 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 393/836] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:01 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:02.447664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:02.448348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:02.455210 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:02.455663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:02.456451 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:02.456891 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:02.589278 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:02.597164 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:02.599160 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:02.600431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-80a68591-984f-42b0-bce0-176f3c75f600 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.156591 Jun 21 10:05:02.600983 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 444/837] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:02 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:03.619108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:03.619717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:03.622093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=32 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:03.627417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:03.627866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:03.628663 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:03.629096 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:03.772815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:03.780807 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:03.782305 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:03.783462 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8a0f5b99-368d-4219-86df-58d2a39b1e64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.168438 Jun 21 10:05:03.784022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 394/838] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:03 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:03.899049 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:03.900003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:03.906456 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:03.906912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:03.907687 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:03.908174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:03.938297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f6fdc092-07d0-4615-aa66-0652b3820ede tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043275 Jun 21 10:05:03.938842 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 445/839] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:03 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:03.948552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:03.949047 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:03.954944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:03.955390 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:03.956186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:03.956627 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:03.984834 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2f37d258-3b3a-4f30-8268-1bb39368d789 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/eb553bee-9a3f-432f-8430-94f2de6e8707" status: 200 len: 194 microversion: 2.1 time: 0.040148 Jun 21 10:05:03.985398 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 395/840] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 21 10:05:03 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/eb553bee-9a3f-432f-8430-94f2de6e8707 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:04.802208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:04.802753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:04.808878 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:04.809332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:04.810094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:04.810534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:04.937453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:04.939722 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:04.947194 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:04.948730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:04.949888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fde13aa7-0a2c-4eaa-9faf-15dc4b3d8289 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.151583 Jun 21 10:05:04.950434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 446/841] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:04 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:05.967885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:05.968538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:05.975274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:05.975721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:05.976526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:05.976963 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:06.102284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:06.110114 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:06.111610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:06.112790 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fcd23346-bf3d-4fa2-8485-43e1b4a6a528 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.148855 Jun 21 10:05:06.113339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 396/842] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:05 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:07.132562 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:07.133242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:07.139726 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:07.140205 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:07.140977 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:07.141421 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:07.275460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:07.283428 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:07.284948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:07.286100 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a002d9f1-9057-4aa4-a7a4-eeca8c1109f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.159410 Jun 21 10:05:07.286646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 447/843] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:07 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:07.387455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69406e05-60a2-46c4-9200-79b442a4ed37"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:07.388606 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:07.395025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:07.395471 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:07.396264 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:07.396701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:07.654993 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7770cc62-c657-4c25-90fc-1f984e82f045 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "POST /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271217 Jun 21 10:05:07.659339 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 397/844] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:05:07 2022] POST /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:08.304194 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:08.304850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:08.311235 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:08.311683 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:08.312462 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:08.312901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:08.438894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:08.448551 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:08.450158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:08.451288 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0666ed6d-2430-4332-b93f-c8381f130458 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1745 microversion: 2.20 time: 0.151136 Jun 21 10:05:08.451837 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 448/845] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:08 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:09.471289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:09.472084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:09.478943 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:09.479391 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:09.480259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:09.480878 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:09.608213 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:09.616946 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:09.618579 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:09.619732 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-263bfb73-96cd-4e7c-8618-a3d9bcdb6955 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1745 microversion: 2.20 time: 0.153235 Jun 21 10:05:09.620310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 398/846] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:09 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:10.638059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:10.638587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:10.645134 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:10.645585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:10.646348 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:10.646785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:10.781746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:10.789749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:10.791226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:10.792506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c70d186c-fc74-4333-9473-1198858da975 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.158333 Jun 21 10:05:10.793048 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 449/847] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:10 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:11.810721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:11.812086 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:11.819149 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:11.820051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:11.820590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:11.821051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:11.997816 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:12.006343 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:12.008419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:12.009578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8f579ab4-73bc-499c-a879-253de1a72253 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.202751 Jun 21 10:05:12.010146 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 399/848] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:11 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:12.801558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-a73f4a4b-c934-492c-b8c9-793d5c501c2c req-e5c29b88-1683-4f5d-971a-1ed370e8c27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "name": "network-vif-plugged", "status": "completed", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:12.819748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-a73f4a4b-c934-492c-b8c9-793d5c501c2c req-e5c29b88-1683-4f5d-971a-1ed370e8c27f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:12.820582 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-a73f4a4b-c934-492c-b8c9-793d5c501c2c req-e5c29b88-1683-4f5d-971a-1ed370e8c27f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:12.832853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-a73f4a4b-c934-492c-b8c9-793d5c501c2c req-e5c29b88-1683-4f5d-971a-1ed370e8c27f service nova] Creating event network-vif-plugged:566f28fb-8556-4b14-a4d3-7df74e335933 for instance e013028d-603c-49de-ad9f-d8f583b1b516 on hv-cinder-80660 Jun 21 10:05:12.842199 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-a73f4a4b-c934-492c-b8c9-793d5c501c2c req-e5c29b88-1683-4f5d-971a-1ed370e8c27f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045033 Jun 21 10:05:12.843516 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 450/849] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:13.027277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:13.028542 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:13.035515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:13.035969 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:13.036765 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:13.037401 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:13.196854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:13.205965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:13.207469 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:13.208724 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-115642ba-81ef-4af4-97bc-96fe09a0faf1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.185345 Jun 21 10:05:13.209533 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 400/850] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:13 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:14.229058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:14.230507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:14.238031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:14.238481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:14.239798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:14.240853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:14.385396 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:14.394594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:14.396146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:14.397537 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-58c35b4b-fd6b-42f2-9312-07bfeee5dbc3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.173231 Jun 21 10:05:14.404786 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 451/851] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:14 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:15.263247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:15.264370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:15.271051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.271781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.272802 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.273322 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.311048 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-937a657d-c786-4c12-9922-4034f20658ec tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051663 Jun 21 10:05:15.311728 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 401/852] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:15 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:15.414758 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:15.415601 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:15.423916 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.424651 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.425588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.426460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.456253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:15.457113 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:15.463863 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.464588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.465536 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.466139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.497184 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:15.501826 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a78fede0-c96b-4577-9863-c313cbb721b6 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/eb553bee-9a3f-432f-8430-94f2de6e8707" status: 200 len: 194 microversion: 2.1 time: 0.052227 Jun 21 10:05:15.507167 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 402/853] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 21 10:05:15 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/eb553bee-9a3f-432f-8430-94f2de6e8707 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:05:15.513313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:15.514005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:15.523558 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.524024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.525001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:15.525591 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:15.617238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:15.627103 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lazy-loading 'services' on Instance uuid 76107a82-b3d2-49da-83fc-a4724bb90252 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:05:15.628745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:15.630457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:15.634676 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-944a95ee-d52f-4f5b-a316-150c5397b588 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.223862 Jun 21 10:05:15.635675 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 452/854] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:15 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:15.709928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-34042f8e-d90d-42b0-8a3a-f27c40895084 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/eb553bee-9a3f-432f-8430-94f2de6e8707" status: 202 len: 0 microversion: 2.1 time: 0.200668 Jun 21 10:05:15.710623 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 403/855] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:05:15 2022] DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/eb553bee-9a3f-432f-8430-94f2de6e8707 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:05:16.654097 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:16.655431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:16.674212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:16.675642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:16.676537 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:16.677232 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:16.845634 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:16.855009 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:16.856563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:16.858039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-29916e1b-2440-4667-8983-9a716d24d785 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.208090 Jun 21 10:05:16.858776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 453/856] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:16 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:17.878634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:17.879371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:17.886455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:17.886908 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:17.887869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:17.888481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:17.896143 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:17.896663 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:17.905447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:17.905913 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:17.906672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:17.907286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:17.946363 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-726cb4e0-4861-4142-82ae-14f2873ba76c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/69406e05-60a2-46c4-9200-79b442a4ed37" status: 200 len: 194 microversion: 2.1 time: 0.055481 Jun 21 10:05:17.947209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 454/857] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 21 10:05:17 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/69406e05-60a2-46c4-9200-79b442a4ed37 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:05:17.958697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:17.959845 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:17.966369 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:17.967242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:17.968438 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:17.969260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:18.039278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:18.053187 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:18.054942 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:18.056634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1a1dd8fb-4df9-4253-bb98-a80097e5573c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.183115 Jun 21 10:05:18.057383 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 404/858] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:17 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:18.077890 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lazy-loading 'services' on Instance uuid 76107a82-b3d2-49da-83fc-a4724bb90252 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:05:18.170715 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-31765010-e4eb-4f36-ba34-de0e195c6edb tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/69406e05-60a2-46c4-9200-79b442a4ed37" status: 202 len: 0 microversion: 2.1 time: 0.216702 Jun 21 10:05:18.174759 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 455/859] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:05:17 2022] DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments/69406e05-60a2-46c4-9200-79b442a4ed37 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:05:19.076686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:19.077296 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:19.090756 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.091219 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.092105 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.092495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.271038 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:19.286450 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:19.293715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:19.296317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-43da1d83-f499-40c2-89c0-ca15d3e41669 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.224092 Jun 21 10:05:19.299401 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 405/860] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:19 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:19.440301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:19.441981 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:19.450224 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.450776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.451998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.452653 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.486022 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e00aee39-d026-466f-ba1d-58d9f79665ad tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051253 Jun 21 10:05:19.486672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 456/861] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:19 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:05:19.621813 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:19.623063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:19.630087 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.630544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.632343 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.632949 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.667170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b8af9adc-48ed-4fd3-a427-4b341997874b tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048906 Jun 21 10:05:19.672034 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 406/862] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:19 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:05:19.753538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:19.754150 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:19.761193 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.761309 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.762249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.762504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.791238 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:05:19.875373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bb7845c5-9a13-413f-a62d-735851adb574 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 204 len: 0 microversion: 2.1 time: 0.127562 Jun 21 10:05:19.876289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 457/863] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:19 2022] DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:05:19.885350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:19.885959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:19.892226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.893077 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:19.893856 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:19.894295 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:20.028069 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:20.035961 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-561764ea-269f-4538-b8ff-b0935ad96548 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1673 microversion: 2.1 time: 0.155280 Jun 21 10:05:20.036539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 407/864] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:19 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:20.317030 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:20.317721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:20.323444 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:20.324102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:20.324864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:20.325294 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:20.456077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:20.464540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:20.466041 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:20.467203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8941e3e0-1a67-488e-80ec-1e70b6deda10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.154463 Jun 21 10:05:20.467757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 458/865] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:20 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:21.052825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:21.053445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:21.060605 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:21.061060 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:21.061827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:21.062270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:21.196775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:21.204297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-30ece258-303c-444b-8b62-5187890c1a16 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1673 microversion: 2.1 time: 0.155277 Jun 21 10:05:21.205331 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 408/866] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:21 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:21.486043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:21.486648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:21.493966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:21.494417 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:21.495176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:21.495609 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:21.622918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:21.630624 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:21.632174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:21.633558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9805216f-5bf1-4776-9496-550fc74a1105 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1740 microversion: 2.20 time: 0.151380 Jun 21 10:05:21.634100 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 459/867] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:21 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:22.221731 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:22.222603 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:22.230263 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:22.230709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:22.231463 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:22.231896 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:22.415967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:22.423897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0787ce8f-6001-4abe-a54d-9049c108f037 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1673 microversion: 2.1 time: 0.206336 Jun 21 10:05:22.424788 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 409/868] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:22 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:22.652461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:22.653288 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:22.660912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:22.661367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:22.662146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:22.662575 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:22.887225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:22.895402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:22.896855 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:22.898051 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fdb11479-1667-49a1-a166-5f017dd0c86c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1722 microversion: 2.20 time: 0.249622 Jun 21 10:05:22.898596 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 460/869] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:22 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:23.441704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:23.443090 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:23.455866 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:23.456741 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:23.459387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:23.460277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:23.470768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-172742e3-121b-4d72-b01e-8343261d7c90 req-596ce4dc-cf0e-4291-9ce4-b1e724ce61fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76107a82-b3d2-49da-83fc-a4724bb90252", "name": "network-vif-deleted", "tag": "635f5804-9761-428d-8320-8ad2ab5cb2b7"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:23.480345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-172742e3-121b-4d72-b01e-8343261d7c90 req-596ce4dc-cf0e-4291-9ce4-b1e724ce61fd service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:23.488450 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-172742e3-121b-4d72-b01e-8343261d7c90 req-596ce4dc-cf0e-4291-9ce4-b1e724ce61fd service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:23.516255 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-172742e3-121b-4d72-b01e-8343261d7c90 req-596ce4dc-cf0e-4291-9ce4-b1e724ce61fd service nova] Creating event network-vif-deleted:635f5804-9761-428d-8320-8ad2ab5cb2b7 for instance 76107a82-b3d2-49da-83fc-a4724bb90252 on hv-cinder-80660 Jun 21 10:05:23.526911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-172742e3-121b-4d72-b01e-8343261d7c90 req-596ce4dc-cf0e-4291-9ce4-b1e724ce61fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059587 Jun 21 10:05:23.527366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 461/870] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:05:23.583024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:23.591315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bd629087-e44b-4e44-9ad5-ecacff17af83 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1606 microversion: 2.1 time: 0.153993 Jun 21 10:05:23.591874 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 410/871] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:23 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1606 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:23.918553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:23.919141 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:23.928522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:23.929079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:23.930396 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:23.930897 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:23.948798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:24.090035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:24.099106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:24.100644 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:24.101826 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d84e79ef-2b76-4c03-a5d9-2fce062d608c tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1722 microversion: 2.20 time: 0.188655 Jun 21 10:05:24.102383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 462/872] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:23 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:24.608233 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:24.608772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:24.616104 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:24.617258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:24.618140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:24.618678 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:24.650228 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:24.650683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:24.651132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lazy-loading 'fault' on Instance uuid 76107a82-b3d2-49da-83fc-a4724bb90252 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:05:24.700554 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fde108762d645bc9c5c5791dfe646a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dc9e553cda4326a9dd10c3e0a35546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:24.707923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-919df9f4-0021-492f-9e4d-bc1a2ae3fea3 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 200 len: 1328 microversion: 2.1 time: 0.103657 Jun 21 10:05:24.708506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 411/873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:24 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:25.119957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:25.120594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:25.122884 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:25.128280 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.128731 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.129529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.129970 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.255117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:25.263470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:25.264991 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:25.266147 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b9284e7f-e7fd-44aa-b347-d12f87822e07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1725 microversion: 2.20 time: 0.150343 Jun 21 10:05:25.266697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 463/874] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:25 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:25.284023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "686bb7ad-3d5f-4088-bed9-1e3293431bb2"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:25.285191 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:25.291188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.291629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.292415 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.292873 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.557111 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fda8614a-34cc-47be-9444-3ed39927d8b1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277064 Jun 21 10:05:25.557698 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 412/875] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jun 21 10:05:25 2022] POST /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-volume_attachments => generated 188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:05:25.669812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:25.670305 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:25.676748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.677209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.678011 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.679586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.724928 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:25.726164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:25.733577 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.734082 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.734859 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.735461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.750745 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] HTTP exception thrown: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Request method failure captured: Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 HTTP/1.1 Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZcFEDIjf-b2T8rRfNe-KhcFNKhN7hQgzFuzOewCtYyw6W5Bk5mx0CPbrxJIPCUUM2qn-pZyt_UBFHDnpNNFh_WtgKYgtNn_SF2zw7oWCOfuuzJrynbRCDmTa-QtUjRXhJ4nQ8-AhGdPrkbPPU3ikr_pRl1ztcqO6U5aw0ru16_Rao Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:25.752578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8dc9e553cda4326a9dd10c3e0a35546"}]}] Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 1fde108762d645bc9c5c5791dfe646a0 Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:25.754033 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '76107a82-b3d2-49da-83fc-a4724bb90252'} Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:25.754815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:25.756772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:25.758520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Returning 404 to user: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:25.758520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-95e4bb7c-0561-47af-91ed-11419cc569e0 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 404 len: 111 microversion: 2.1 time: 0.032948 Jun 21 10:05:25.758520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 413/876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:25 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:05:25.759998 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-60158eb0-167f-4435-b406-1d226c384e27 req-251b658e-d158-45ca-b396-33afc8eb1fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "name": "network-vif-unplugged", "status": "completed", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:25.768515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-60158eb0-167f-4435-b406-1d226c384e27 req-251b658e-d158-45ca-b396-33afc8eb1fda service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:25.768971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-60158eb0-167f-4435-b406-1d226c384e27 req-251b658e-d158-45ca-b396-33afc8eb1fda service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:25.780506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.compute.server_external_events [req-60158eb0-167f-4435-b406-1d226c384e27 req-251b658e-d158-45ca-b396-33afc8eb1fda service nova] Unable to find a host for instance e013028d-603c-49de-ad9f-d8f583b1b516. Dropping event network-vif-unplugged {{(pid=117564) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 10:05:25.781265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-60158eb0-167f-4435-b406-1d226c384e27 req-251b658e-d158-45ca-b396-33afc8eb1fda service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025852 Jun 21 10:05:25.782068 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 414/877] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 10:05:25.786701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d8220dff-e660-4f71-826e-92bf15a8288c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '.version_select at 0x7f184aafd700>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:25.806645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d8220dff-e660-4f71-826e-92bf15a8288c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712604290" status: 202 len: 0 microversion: 2.1 time: 0.023371 Jun 21 10:05:25.807655 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 415/878] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 21 10:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712604290 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:05:25.953856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ff4dda43-e2d8-43e1-b449-531aa40b3812 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-volume_attachments/686bb7ad-3d5f-4088-bed9-1e3293431bb2" status: 202 len: 0 microversion: 2.20 time: 0.287873 Jun 21 10:05:25.954459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 464/879] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jun 21 10:05:25 2022] DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-volume_attachments/686bb7ad-3d5f-4088-bed9-1e3293431bb2 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:05:26.016243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:26.016823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:26.022810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:26.023284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:26.024164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:26.024602 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:26.220779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7b28a672-a0b4-42b6-95e4-0c3b43a46a89 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "POST /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/action" status: 202 len: 0 microversion: 2.20 time: 0.208593 Jun 21 10:05:26.221742 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 416/880] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 21 10:05:26 2022] POST /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:05:26.230373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:26.231130 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:26.238639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:26.239216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:26.240084 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:26.240587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:26.463222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:26.471274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:26.472978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:26.474162 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-771bfef5-ee6c-4012-b767-30e0200ddc68 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1673 microversion: 2.20 time: 0.248293 Jun 21 10:05:26.474716 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 465/881] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:26 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:27.493779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:27.494389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:27.500480 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:27.500933 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:27.501705 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:27.502143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:27.506116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:27.634638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:27.642739 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:27.644277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:27.645428 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a475ae05-ef84-4f46-a892-e44c582023a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.156543 Jun 21 10:05:27.645985 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 417/882] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:27 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:28.664966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:28.665565 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:28.671947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:28.672429 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:28.673187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:28.673653 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:28.797235 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:28.798692 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:28.811250 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:28.811951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:28.813131 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:28.813877 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:28.821176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:28.843266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:28.848004 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:28.853744 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-16911be3-9ef9-42d7-bc4b-b00c435b33cf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.191043 Jun 21 10:05:28.856756 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 466/883] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:28 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:05:28.867362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] HTTP exception thrown: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Request method failure captured: Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 HTTP/1.1 Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZcFEDIjf-b2T8rRfNe-KhcFNKhN7hQgzFuzOewCtYyw6W5Bk5mx0CPbrxJIPCUUM2qn-pZyt_UBFHDnpNNFh_WtgKYgtNn_SF2zw7oWCOfuuzJrynbRCDmTa-QtUjRXhJ4nQ8-AhGdPrkbPPU3ikr_pRl1ztcqO6U5aw0ru16_Rao Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:28.869189 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8dc9e553cda4326a9dd10c3e0a35546"}]}] Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 1fde108762d645bc9c5c5791dfe646a0 Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.870760 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '76107a82-b3d2-49da-83fc-a4724bb90252'} Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:28.871626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.872999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.875310 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Returning 404 to user: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:28.876354 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-59464664-0ef5-4930-97cd-f803c5c4f1a1 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 404 len: 111 microversion: 2.1 time: 0.085227 Jun 21 10:05:28.877047 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 418/884] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:28 2022] DELETE /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:28.885760 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:28.888639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: 76107a82-b3d2-49da-83fc-a4724bb90252] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:28.900556 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:28.901489 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:28.903151 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:28.904057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:28.933695 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] HTTP exception thrown: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Request method failure captured: Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 HTTP/1.1 Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZcFEDIjf-b2T8rRfNe-KhcFNKhN7hQgzFuzOewCtYyw6W5Bk5mx0CPbrxJIPCUUM2qn-pZyt_UBFHDnpNNFh_WtgKYgtNn_SF2zw7oWCOfuuzJrynbRCDmTa-QtUjRXhJ4nQ8-AhGdPrkbPPU3ikr_pRl1ztcqO6U5aw0ru16_Rao Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:28.936956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8dc9e553cda4326a9dd10c3e0a35546"}]}] Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 1fde108762d645bc9c5c5791dfe646a0 Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.938865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '76107a82-b3d2-49da-83fc-a4724bb90252'} Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:28.939851 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. Jun 21 10:05:28.941577 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:28.942867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Returning 404 to user: Instance 76107a82-b3d2-49da-83fc-a4724bb90252 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:28.942867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-49f73d59-9f55-4dbe-b6e4-eeb6cb265c9c tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252" status: 404 len: 111 microversion: 2.1 time: 0.057888 Jun 21 10:05:28.944355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 467/885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:28 2022] GET /compute/v2.1/servers/76107a82-b3d2-49da-83fc-a4724bb90252 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:29.556400 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:29.556902 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:29.563196 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:29.563682 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:29.564491 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:29.564941 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:29.591922 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2e9f11f7-f518-47a6-91a3-28f189d2654f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/ips" status: 200 len: 150 microversion: 2.1 time: 0.040189 Jun 21 10:05:29.592872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 419/886] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:05:29 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:29.874734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:29.875576 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:29.888323 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:29.889249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:29.893098 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:29.894059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:30.125888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:30.135590 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:30.137476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:30.139350 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ebd07f86-efe4-4e07-8c99-19779b4e5acf tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.269045 Jun 21 10:05:30.139906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 468/887] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:29 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:30.146317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:30.147408 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:30.156053 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:30.156996 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:30.158221 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:30.158984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:30.174653 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] HTTP exception thrown: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Request method failure captured: Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe HTTP/1.1 Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZcFEDIjf-b2T8rRfNe-KhcFNKhN7hQgzFuzOewCtYyw6W5Bk5mx0CPbrxJIPCUUM2qn-pZyt_UBFHDnpNNFh_WtgKYgtNn_SF2zw7oWCOfuuzJrynbRCDmTa-QtUjRXhJ4nQ8-AhGdPrkbPPU3ikr_pRl1ztcqO6U5aw0ru16_Rao Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:30.176301 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8dc9e553cda4326a9dd10c3e0a35546"}]}] Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 1fde108762d645bc9c5c5791dfe646a0 Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.177882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe'} Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:30.178954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.180473 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.182050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Returning 404 to user: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:30.182050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4b97f645-62ae-4475-8921-5d64923c8ca4 tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 404 len: 111 microversion: 2.1 time: 0.035700 Jun 21 10:05:30.182050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 420/888] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:30 2022] DELETE /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:30.186425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:30.187040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] [instance: c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:30.193738 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:30.194360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:30.195175 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:30.195763 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:30.210035 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] HTTP exception thrown: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Request method failure captured: Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe HTTP/1.1 Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZcFEDIjf-b2T8rRfNe-KhcFNKhN7hQgzFuzOewCtYyw6W5Bk5mx0CPbrxJIPCUUM2qn-pZyt_UBFHDnpNNFh_WtgKYgtNn_SF2zw7oWCOfuuzJrynbRCDmTa-QtUjRXhJ4nQ8-AhGdPrkbPPU3ikr_pRl1ztcqO6U5aw0ru16_Rao Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:30.212283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8dc9e553cda4326a9dd10c3e0a35546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8dc9e553cda4326a9dd10c3e0a35546"}]}] Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c8dc9e553cda4326a9dd10c3e0a35546 Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-584138837 Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 1fde108762d645bc9c5c5791dfe646a0 Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeTestJSON-584138837-project Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.214136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe'} Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:30.215177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. Jun 21 10:05:30.216817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:30.219179 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] Returning 404 to user: Instance c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:30.220151 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c50f8bb3-e93e-4e38-80c0-f10f0fef13ef tempest-AttachVolumeTestJSON-584138837 tempest-AttachVolumeTestJSON-584138837-project] 10.222.0.36 "GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe" status: 404 len: 111 microversion: 2.1 time: 0.037648 Jun 21 10:05:30.220748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 469/889] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:30 2022] GET /compute/v2.1/servers/c8c3dc1d-5c63-4b58-b5c5-e7628ea26ebe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:31.045327 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f35034c-d0de-4fd9-8165-2836f8964702"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:31.046415 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:31.053055 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:31.053721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:31.055386 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:31.056000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:31.158741 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:31.161500 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:31.176475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:31.177420 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:31.178769 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:31.180771 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:31.442285 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:31.454021 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:31.455559 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:31.457101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e7bc296d-d796-4540-80a5-41f109960af8 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.302670 Jun 21 10:05:31.468460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 470/890] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:31 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:05:32.475377 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:32.476148 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:32.489968 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:32.490433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:32.492029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:32.492526 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:32.765210 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:32.779067 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:32.782528 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:32.783941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-23814973-2e54-43a6-8870-450fcf509f6d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.312988 Jun 21 10:05:32.784861 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 471/891] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:32 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:05:33.802040 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:33.802785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:33.815631 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:33.816340 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:33.817299 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:33.817902 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:34.154626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:34.170448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:34.172538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:34.174248 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4c8cdc0d-0619-4b8a-9a46-313495a0bf64 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.376217 Jun 21 10:05:34.175644 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 472/892] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:33 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:35.192585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:35.193941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:35.202813 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:35.203391 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:35.204360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:35.204925 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:35.377411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:35.391384 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:35.394213 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:35.395636 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3cdab590-9513-4eea-8cf3-6af45c0b2ea6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.206822 Jun 21 10:05:35.396648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 473/893] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:35 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:05:36.417620 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:36.419053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:36.426918 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:36.427626 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:36.428445 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:36.429569 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:36.586920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:36.597015 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:36.599109 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:36.599784 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3680c27d-d6eb-4d7e-9e9e-c9c79dbc8a36 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.187272 Jun 21 10:05:36.600645 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 474/894] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:36 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:05:37.618850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:37.619566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:37.626024 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:37.626476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:37.627236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:37.627670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:37.763885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:37.779764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:37.781132 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:37.782441 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eeb3b06f-7c8f-4058-a9d8-5a0cc888e67d tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.167783 Jun 21 10:05:37.783175 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 475/895] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:37 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:05:38.211779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-76018334-3f17-4efc-b20e-2327c6478938 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "POST /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.171371 Jun 21 10:05:38.212748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 421/896] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 21 10:05:31 2022] POST /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments => generated 194 bytes in 7173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:38.801204 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:38.801917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:38.808535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:38.808986 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:38.809822 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:38.810262 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:38.947176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:38.955074 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:38.956598 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:38.957768 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c40bb46a-6956-48a1-9603-3b4b6dd05689 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.160682 Jun 21 10:05:38.958309 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 476/897] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:38 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:39.978008 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:39.978694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:39.980651 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:39.986081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:39.986522 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:39.987278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:39.987709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:40.114453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:40.123045 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:40.124607 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:40.125761 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1978ef4a-3a2d-4468-85c4-fe46eccb3507 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.153126 Jun 21 10:05:40.126305 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 422/898] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:39 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:41.144266 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:41.144870 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:41.151361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:41.151805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:41.152602 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:41.153039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:41.279367 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:41.282699 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:41.287932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:41.289915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:41.291277 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-037d7444-527b-4cae-a1c8-9880906c9c07 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.150924 Jun 21 10:05:41.291834 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 477/899] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:41 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:41.866810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-2e12ff67-5b96-4ea9-9cf4-312b1e65660f req-ed7b2b6a-d57a-4934-a28d-96af6c11df9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "name": "network-vif-plugged", "status": "completed", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:41.876267 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-2e12ff67-5b96-4ea9-9cf4-312b1e65660f req-ed7b2b6a-d57a-4934-a28d-96af6c11df9d service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:41.876847 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-2e12ff67-5b96-4ea9-9cf4-312b1e65660f req-ed7b2b6a-d57a-4934-a28d-96af6c11df9d service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:41.889902 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-2e12ff67-5b96-4ea9-9cf4-312b1e65660f req-ed7b2b6a-d57a-4934-a28d-96af6c11df9d service nova] Creating event network-vif-plugged:566f28fb-8556-4b14-a4d3-7df74e335933 for instance e013028d-603c-49de-ad9f-d8f583b1b516 on hv-cinder-80660 Jun 21 10:05:41.895092 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-2e12ff67-5b96-4ea9-9cf4-312b1e65660f req-ed7b2b6a-d57a-4934-a28d-96af6c11df9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Jun 21 10:05:41.896098 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 423/900] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:42.309942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:42.310465 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:42.317709 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:42.318158 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:42.318924 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:42.319362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:42.444961 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:42.452954 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:42.454448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:42.455611 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d24bee43-c3a1-4d5b-866a-9042ab12720f tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.150037 Jun 21 10:05:42.456197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 478/901] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:42 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:43.040870 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:43.041448 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:43.048088 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:43.048533 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:43.049287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:43.049718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:43.074193 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:05:43.161302 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c4373fe2-6a3a-4840-8444-620f5c8039ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 204 len: 0 microversion: 2.1 time: 0.124883 Jun 21 10:05:43.164162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 424/902] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:43 2022] DELETE /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:05:43.170905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:43.171533 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:43.178130 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:43.178586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:43.179373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:43.179998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:43.332134 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:43.340499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9fe8e5f8-5a08-4902-9108-e9bef7b63742 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1577 microversion: 2.1 time: 0.173815 Jun 21 10:05:43.341057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 479/903] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:43 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:43.474036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:43.474736 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:43.480746 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:43.481218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:43.481980 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:43.482419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:43.622492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:43.630323 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:43.631812 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:43.633579 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0854794f-c3e3-4b68-8e66-62213e314886 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.163849 Jun 21 10:05:43.634123 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 425/904] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:43 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:44.357672 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:44.358219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:44.364856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:44.365312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:44.366832 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:44.367479 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:44.503850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:44.512135 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e7582c5a-622b-45d4-bc0f-759a91f71d49 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1577 microversion: 2.1 time: 0.158307 Jun 21 10:05:44.513256 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 480/905] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:44 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:44.652289 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:44.652923 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:44.659758 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:44.660277 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:44.661227 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:44.661761 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:44.812869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:44.821039 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:44.822523 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:44.823668 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2da03688-c5c6-485b-8008-de6c69225385 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1731 microversion: 2.20 time: 0.176996 Jun 21 10:05:44.824369 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 426/906] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:44 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:45.529856 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:45.530395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:45.536930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:45.537381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:45.538142 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:45.538630 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:45.675362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:45.682947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-732ccf4a-7158-48a8-a1d9-902beb4ea955 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1577 microversion: 2.1 time: 0.156987 Jun 21 10:05:45.683501 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 481/907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:45 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:45.841998 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:45.842695 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:45.848978 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:45.849427 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:45.850197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:45.850637 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:46.002434 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:46.011424 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:46.013098 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:46.014433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-23a4c0ee-6ef7-481c-8e93-29f5e9388497 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1718 microversion: 2.20 time: 0.176486 Jun 21 10:05:46.014986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 427/908] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:05:45 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:05:46.699700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:46.700343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:46.706746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:46.707550 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:46.708059 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:46.708506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:46.782627 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:46.790916 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-71c36c19-6b84-46a8-aba7-8be8b1d9ab0c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1509 microversion: 2.1 time: 0.095031 Jun 21 10:05:46.792105 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 482/909] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:46 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1509 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:46.874364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:46.874902 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:46.881436 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:46.882427 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:46.884303 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:46.884741 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:46.968686 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lazy-loading 'services' on Instance uuid 4b9ddc0d-061c-4316-b73d-2769962f85de {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:05:47.046250 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-99c1bfbc-b609-46be-902c-8a4ff02b0635 req-b39254de-0821-4de8-9b06-76fd3858f739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a76d1a-f9e8-459f-92ad-02a806ab20ab", "name": "network-vif-deleted", "tag": "cc0f7d8e-9dc6-4782-8fb4-190065a75b9f"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:47.058117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-99c1bfbc-b609-46be-902c-8a4ff02b0635 req-b39254de-0821-4de8-9b06-76fd3858f739 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:47.058563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-99c1bfbc-b609-46be-902c-8a4ff02b0635 req-b39254de-0821-4de8-9b06-76fd3858f739 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:47.072371 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8d77a134-adee-4ee9-902d-08caad987efa tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments/1f35034c-d0de-4fd9-8165-2836f8964702" status: 202 len: 0 microversion: 2.1 time: 0.201671 Jun 21 10:05:47.073569 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 428/910] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 21 10:05:46 2022] DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments/1f35034c-d0de-4fd9-8165-2836f8964702 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:05:47.082726 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:47.084073 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-99c1bfbc-b609-46be-902c-8a4ff02b0635 req-b39254de-0821-4de8-9b06-76fd3858f739 service nova] Creating event network-vif-deleted:cc0f7d8e-9dc6-4782-8fb4-190065a75b9f for instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab on hv-cinder-80660 Jun 21 10:05:47.088296 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:47.092240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-99c1bfbc-b609-46be-902c-8a4ff02b0635 req-b39254de-0821-4de8-9b06-76fd3858f739 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049894 Jun 21 10:05:47.093475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 483/911] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:47.103621 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:47.104213 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:47.105450 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:47.106275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:47.148559 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d0fd8b01-e8fd-4624-ba6e-3a856cf8a6a7 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069437 Jun 21 10:05:47.149448 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 429/912] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:47 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:47.808896 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:47.809593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:47.816725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:47.817201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:47.817978 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:47.818603 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:47.849876 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:47.850240 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:47.851177 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lazy-loading 'fault' on Instance uuid e5a76d1a-f9e8-459f-92ad-02a806ab20ab {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:05:47.892852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:47.900346 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-247f9675-5573-46af-b06d-384e07233edb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 200 len: 1231 microversion: 2.1 time: 0.096387 Jun 21 10:05:47.900917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 484/913] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:47 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:48.164298 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:48.166106 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:48.174164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:48.174835 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:48.176278 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:48.176839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:48.210951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1acdd16e-38a0-4a9c-a71b-f55fdc519dce tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052755 Jun 21 10:05:48.211510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 430/914] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:48 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:48.917839 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:48.918355 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:48.924869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:48.925326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:48.926085 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:48.926522 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:48.939459 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] HTTP exception thrown: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Request method failure captured: Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab HTTP/1.1 Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZcqPQgtEB6yMnn4oGcnSDFApd7y9B0nw11rlkvYOdTjGkuTJMW2BJeQ_Y-F2S7O7aTVxsWUff5qmm8tPBZHR5kWp324gMkwBDjO5Z4oopo0dUr6S2KfID_KrpNP77oP1E6Y_22xRgB-UbLtSF4RK3n8THUj8_3IrZwPwQ1_lygJHRU Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:48.941104 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95b4310d4b154732b31c773044f56154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95b4310d4b154732b31c773044f56154"}]}] Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestVolumeBootPattern-339556319 Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: b51e11f068d948a889871ce53ce29ceb Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:05:48.942764 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'e5a76d1a-f9e8-459f-92ad-02a806ab20ab'} Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:48.943719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:05:48.945747 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:48.947325 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Returning 404 to user: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:48.947325 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b8942da1-5f4b-45b4-a5b4-2360aedc8514 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 404 len: 111 microversion: 2.1 time: 0.029220 Jun 21 10:05:48.947325 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 485/915] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:48 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:49.045143 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-214142202", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1958769818", "security_groups": [{"name": "tempest-secgroup-smoke-1519349506"}], "block_device_mapping_v2": [{"uuid": "c490195c-ee76-40e0-bf11-f049a91fb8ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb4c5df0-05d0-4ec2-aa30-ec9c2dbcfbdd"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:49.158585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] validate_networks() for [('eb4c5df0-05d0-4ec2-aa30-ec9c2dbcfbdd', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:05:49.222574 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:49.223566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:49.229730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.230181 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.231477 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.231477 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.260864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f1cbef3b-9c4d-4cec-ac43-d01ebbdab912 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042208 Jun 21 10:05:49.261416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 486/916] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 21 10:05:49 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 10:05:49.318790 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:49.319295 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:49.326039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.326495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.327281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.327721 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.353814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:05:49.431996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-459b8d01-2e6d-4927-86fb-199d4a1957ae tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 204 len: 0 microversion: 2.1 time: 0.116900 Jun 21 10:05:49.432604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 487/917] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:49 2022] DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:05:49.441561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:49.442330 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:49.449265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.449715 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.450581 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.450908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.535337 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:05:49.535820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:05:49.536253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:05:49.536855 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:05:49.537318 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:05:49.546590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.547031 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.547831 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:49.548298 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:49.565333 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for project 95b4310d4b154732b31c773044f56154. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:05:49.570136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for user b51e11f068d948a889871ce53ce29ceb and project 95b4310d4b154732b31c773044f56154. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:05:49.584039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:49.591876 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-78f430a4-727d-4b63-a270-7477d9f28ed2 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1681 microversion: 2.1 time: 0.154649 Jun 21 10:05:49.592495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 488/918] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:49 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:05:49.626099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:05:49.628739 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c490195c-ee76-40e0-bf11-f049a91fb8ad',volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:05:49.757850 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0bfb3ee8-862b-4192-974f-37b6b12a9c22 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715822 Jun 21 10:05:49.758865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 431/919] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:05:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:05:49.768791 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-48639abc-160d-40c4-86ce-789fcab748f0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:49.769700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-48639abc-160d-40c4-86ce-789fcab748f0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:49.830838 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-48639abc-160d-40c4-86ce-789fcab748f0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:49.837823 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-48639abc-160d-40c4-86ce-789fcab748f0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1094 microversion: 2.1 time: 0.072780 Jun 21 10:05:49.838380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 489/920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:49 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:05:50.609621 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:50.610229 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:50.617834 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:50.618265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:50.619169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:50.619660 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:50.756170 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:50.764247 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6643a291-cfbb-4743-b8f9-24e245417c4f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1681 microversion: 2.1 time: 0.158651 Jun 21 10:05:50.764804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 432/921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:50 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:50.853462 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:50.854097 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:50.860671 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:50.861063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:50.861821 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:50.862259 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:50.924888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:50.932583 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2302a6b4-a8c7-48d6-b9bd-fe362fe24e12 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1144 microversion: 2.1 time: 0.082973 Jun 21 10:05:50.933140 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 490/922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:50 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:51.781061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:51.782412 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:51.790809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:51.791518 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:51.792654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:51.793250 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:51.821340 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:51.887580 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d76c556b5f41f19c1a2a466a031cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5852acb729432e89c68955c8ed5e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:51.898625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f1d9e793-5156-4400-9ff5-d5156c4c7243 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 200 len: 1614 microversion: 2.1 time: 0.120174 Jun 21 10:05:51.899596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 433/923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:51 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 1614 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:51.949713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:51.950982 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:51.957774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:51.958223 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:51.958998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:51.959688 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:52.030677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:52.038993 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e82054df-1da0-418a-82cd-5f0b029b8bc2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1210 microversion: 2.1 time: 0.092505 Jun 21 10:05:52.039564 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 491/924] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:51 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:52.197319 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-cfad8e85-eeac-4cce-9486-76282072b77a req-231634be-1efa-4940-9f00-b61b4da286dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9ddc0d-061c-4316-b73d-2769962f85de", "name": "network-vif-deleted", "tag": "df3cbd27-169f-43f7-934e-031db914b7cb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:52.214068 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-cfad8e85-eeac-4cce-9486-76282072b77a req-231634be-1efa-4940-9f00-b61b4da286dd service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:52.214245 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-cfad8e85-eeac-4cce-9486-76282072b77a req-231634be-1efa-4940-9f00-b61b4da286dd service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:52.227956 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-cfad8e85-eeac-4cce-9486-76282072b77a req-231634be-1efa-4940-9f00-b61b4da286dd service nova] Creating event network-vif-deleted:df3cbd27-169f-43f7-934e-031db914b7cb for instance 4b9ddc0d-061c-4316-b73d-2769962f85de on hv-cinder-80660 Jun 21 10:05:52.234099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-cfad8e85-eeac-4cce-9486-76282072b77a req-231634be-1efa-4940-9f00-b61b4da286dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045118 Jun 21 10:05:52.235022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 434/925] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:05:52.917864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:52.918800 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:52.928166 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:52.928844 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:52.930162 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:52.930713 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:52.976201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de HTTP/1.1 Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:52.980076 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:52.981828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '4b9ddc0d-061c-4316-b73d-2769962f85de'} Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:52.982778 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:52.984371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:52.986366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:52.990528 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8bae567a-80be-445c-957d-db151b677f45 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 404 len: 111 microversion: 2.1 time: 0.078541 Jun 21 10:05:52.996236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 492/926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:52 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:53.009613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dfd54a23-1f82-4432-9fee-b38b68ac8bcb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '.version_select at 0x7f184aa991f0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:53.030904 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dfd54a23-1f82-4432-9fee-b38b68ac8bcb tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119250998" status: 202 len: 0 microversion: 2.1 time: 0.032932 Jun 21 10:05:53.031481 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 435/927] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 21 10:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119250998 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:05:53.061893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:53.062780 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:53.097837 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:53.098541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:53.103616 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:53.104748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:53.310974 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:53.334736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-993f2d7d-1eae-47be-befd-8906a7f9a4d8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.281698 Jun 21 10:05:53.337305 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 493/928] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:53 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:54.354830 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:54.355731 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:54.363946 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:54.364438 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:54.365377 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:54.365913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:54.439425 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-9d3a540d-29f9-48d0-8722-986929de8c64 req-1c77e087-b5f2-47aa-9c97-9fff50ad0542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e618752-2a25-40b4-8c2f-5630d4f18ba4", "tag": "04d5b713-1489-4c7c-a451-3dca2b8d1a52"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:05:54.455360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9d3a540d-29f9-48d0-8722-986929de8c64 req-1c77e087-b5f2-47aa-9c97-9fff50ad0542 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:54.456089 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9d3a540d-29f9-48d0-8722-986929de8c64 req-1c77e087-b5f2-47aa-9c97-9fff50ad0542 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:54.485465 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-9d3a540d-29f9-48d0-8722-986929de8c64 req-1c77e087-b5f2-47aa-9c97-9fff50ad0542 service nova] Creating event network-changed:04d5b713-1489-4c7c-a451-3dca2b8d1a52 for instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 on hv-cinder-80660 Jun 21 10:05:54.493549 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-9d3a540d-29f9-48d0-8722-986929de8c64 req-1c77e087-b5f2-47aa-9c97-9fff50ad0542 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061571 Jun 21 10:05:54.494492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 494/929] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:05:54.693612 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:54.703273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-229d3b52-5000-4df9-90c2-1f8ffbd6ca13 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.352662 Jun 21 10:05:54.704055 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 436/930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:54 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:55.634650 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:55.635234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:55.637657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:55.643034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:55.643490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:55.644284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:55.644732 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:55.658664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de HTTP/1.1 Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:55.660361 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.661730 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '4b9ddc0d-061c-4316-b73d-2769962f85de'} Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:55.665536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.666785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.668023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:55.668023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b0cf11a3-2555-4419-b2a9-df9533f9e897 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 404 len: 111 microversion: 2.1 time: 0.031888 Jun 21 10:05:55.668023 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 495/931] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:55 2022] DELETE /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:55.670237 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:55.670875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 4b9ddc0d-061c-4316-b73d-2769962f85de] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:55.677197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:55.677683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:55.678556 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:55.679477 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:55.692810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de HTTP/1.1 Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:55.695064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.696715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '4b9ddc0d-061c-4316-b73d-2769962f85de'} Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:55.697757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. Jun 21 10:05:55.699032 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:55.700318 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 4b9ddc0d-061c-4316-b73d-2769962f85de could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:55.700318 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2a2a6e00-85a8-4eee-8563-e983db124818 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de" status: 404 len: 111 microversion: 2.1 time: 0.030105 Jun 21 10:05:55.700318 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 437/932] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:55 2022] GET /compute/v2.1/servers/4b9ddc0d-061c-4316-b73d-2769962f85de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:55.720900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:55.721865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:55.727999 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:55.728643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:55.729422 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:55.729862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:55.868641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:55.872154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:55.877207 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed15fa69-86c5-46bd-92ae-5b46f8f7c8f7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.160745 Jun 21 10:05:55.877785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 496/933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:55 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:56.838005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:56.838533 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:56.844899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.845350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.846111 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.846546 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.859838 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea HTTP/1.1 Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:56.861378 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.863065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '305651e2-488f-4fed-a8d9-2997709c96ea'} Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:56.863869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.865497 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.867563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:56.867563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0cb00971-50fa-4092-b460-fe2e0412a63f tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 404 len: 111 microversion: 2.1 time: 0.029712 Jun 21 10:05:56.867563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 438/934] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:56 2022] DELETE /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:56.871329 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:56.871948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 305651e2-488f-4fed-a8d9-2997709c96ea] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:56.880033 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.880456 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.881226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.881664 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.894117 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:56.894724 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:56.898748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea HTTP/1.1 Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:56.900333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.901927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '305651e2-488f-4fed-a8d9-2997709c96ea'} Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:56.902762 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. Jun 21 10:05:56.904019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.905234 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 305651e2-488f-4fed-a8d9-2997709c96ea could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:56.905316 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.905316 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.905471 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b5411057-9710-46a8-bb6b-df7b89adefe6 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea" status: 404 len: 111 microversion: 2.1 time: 0.034208 Jun 21 10:05:56.905547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.905623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 497/935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:56 2022] GET /compute/v2.1/servers/305651e2-488f-4fed-a8d9-2997709c96ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:56.905715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.909708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:56.910203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:56.916113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.916567 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.917332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.917771 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.931048 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f HTTP/1.1 Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:56.933064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.935879 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '9b2b3d4c-ca98-448e-a982-9d6d673cb24f'} Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:56.936915 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.938176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.940114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:56.940114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-affbaafe-ac9a-425e-83d4-55def38c392e tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 404 len: 111 microversion: 2.1 time: 0.028895 Jun 21 10:05:56.940114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 498/936] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:56 2022] DELETE /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:56.943717 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:56.944861 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 9b2b3d4c-ca98-448e-a982-9d6d673cb24f] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:56.950808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.951267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.952064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:56.952507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:56.966712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f HTTP/1.1 Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:05:56.968225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.970039 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '9b2b3d4c-ca98-448e-a982-9d6d673cb24f'} Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:56.971069 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. Jun 21 10:05:56.973618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:05:56.974912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 9b2b3d4c-ca98-448e-a982-9d6d673cb24f could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:56.974912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a8e0c20f-f740-447d-b347-446f2caede35 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f" status: 404 len: 111 microversion: 2.1 time: 0.029503 Jun 21 10:05:56.974912 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 499/937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:56 2022] GET /compute/v2.1/servers/9b2b3d4c-ca98-448e-a982-9d6d673cb24f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:57.042950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:57.050317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c51031a1-1307-4337-b9b9-5ef5a56e82fa tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.159937 Jun 21 10:05:57.050865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 439/938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:56 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:05:58.068022 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:58.068667 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:58.076010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:58.076447 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:58.077479 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:58.077976 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:58.110297 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:58.111552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:58.118625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:58.119072 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:58.119841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:58.120306 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:58.134257 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 HTTP/1.1 Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:58.136009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.137625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '8f4f0fd3-df72-4ad2-bf46-da230bb50235'} Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:58.138544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.140051 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.141631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:58.141631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0fa0d871-5998-4a91-ac2d-a716ccb03ee9 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 404 len: 111 microversion: 2.1 time: 0.030907 Jun 21 10:05:58.141631 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 440/939] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:05:58 2022] DELETE /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:58.149951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:58.150560 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] [instance: 8f4f0fd3-df72-4ad2-bf46-da230bb50235] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:58.156784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:58.157243 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:58.158021 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:58.158639 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:58.172841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] HTTP exception thrown: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Request method failure captured: Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 HTTP/1.1 Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZhsNH3uiWdutdC_gOlWitJ5D-H_ypzV-_4OoSjPc8ek0ufA43glN_Zk4RzqScFAeSkETsi5OL3HdJGi9aLgrmosNmF2efNhIMtrTPpuw6pDp8FPn5LDj51IZrB27VGoPH7rM63Volk_VXks1fb2slTANGxYbXLn0bsDax8YoqEkOo Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:05:58.174350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1a5852acb729432e89c68955c8ed5e8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1a5852acb729432e89c68955c8ed5e8b"}]}] Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1a5852acb729432e89c68955c8ed5e8b Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1829815841 Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: d3d76c556b5f41f19c1a2a466a031cdf Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1829815841-project Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.175938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '8f4f0fd3-df72-4ad2-bf46-da230bb50235'} Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:05:58.176885 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. Jun 21 10:05:58.178300 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:05:58.181052 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] Returning 404 to user: Instance 8f4f0fd3-df72-4ad2-bf46-da230bb50235 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:05:58.181052 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a5ff69ba-ea72-4bca-a035-044fa75185d5 tempest-AttachVolumeNegativeTest-1829815841 tempest-AttachVolumeNegativeTest-1829815841-project] 10.222.0.36 "GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235" status: 404 len: 111 microversion: 2.1 time: 0.029641 Jun 21 10:05:58.181052 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 441/940] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:58 2022] GET /compute/v2.1/servers/8f4f0fd3-df72-4ad2-bf46-da230bb50235 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:05:58.220337 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:58.234043 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f5d5d2e8-f032-4051-9bba-8f875d05b54c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.169957 Jun 21 10:05:58.234594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 500/941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:58 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:05:59.251515 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:05:59.252501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:05:59.259584 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:59.260155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:59.261102 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:05:59.262107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:05:59.556548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:59.577173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:59.794122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:05:59.806158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b6d5df75-1d0d-4d82-96c3-51405cf15474 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.558873 Jun 21 10:05:59.807274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 442/942] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:05:59 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:00.827244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:00.828677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:00.831229 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:00.838231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:00.839126 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:00.840464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:00.841900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:00.987576 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:00.998275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-640aa76b-e657-4902-9efd-fe443940467f tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.175997 Jun 21 10:06:01.007866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 501/943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:00 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:02.015161 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:02.015938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:02.026582 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:02.027034 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:02.027810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:02.028284 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:02.211778 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:02.222506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9f8720f1-3520-4daf-bcef-60928a281cfe tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.211380 Jun 21 10:06:02.223085 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 443/944] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:02 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:03.239285 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:03.239908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:03.249485 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:03.250146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:03.250930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:03.251375 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:03.380805 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:03.389088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-43b3b97e-11c3-4efa-9877-9936131274f5 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.154185 Jun 21 10:06:03.389643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 502/945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:03 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:04.405346 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:04.405989 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:04.412683 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:04.413168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:04.413938 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:04.414379 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:04.560750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:04.568781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6cf1e99e-f3a2-41e5-a44f-b5eec30500f8 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.167179 Jun 21 10:06:04.570227 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 444/946] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:04 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:05.586638 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:05.587251 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:05.594366 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:05.594816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:05.595615 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:05.596079 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:05.734475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:05.742245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1da76672-1d63-47f7-9b14-005e217250d7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.160030 Jun 21 10:06:05.742787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 503/947] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:05 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:06.042526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-5d8edf7a-4a34-4cd1-98bd-4b094a0028f7 req-d45271c0-2620-4487-a925-b61991828a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e618752-2a25-40b4-8c2f-5630d4f18ba4", "name": "network-vif-plugged", "status": "completed", "tag": "04d5b713-1489-4c7c-a451-3dca2b8d1a52"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:06.052083 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-5d8edf7a-4a34-4cd1-98bd-4b094a0028f7 req-d45271c0-2620-4487-a925-b61991828a0b service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:06.052596 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-5d8edf7a-4a34-4cd1-98bd-4b094a0028f7 req-d45271c0-2620-4487-a925-b61991828a0b service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:06.066186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-5d8edf7a-4a34-4cd1-98bd-4b094a0028f7 req-d45271c0-2620-4487-a925-b61991828a0b service nova] Creating event network-vif-plugged:04d5b713-1489-4c7c-a451-3dca2b8d1a52 for instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 on hv-cinder-80660 Jun 21 10:06:06.073444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-5d8edf7a-4a34-4cd1-98bd-4b094a0028f7 req-d45271c0-2620-4487-a925-b61991828a0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Jun 21 10:06:06.074071 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 445/948] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:06.760052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:06.760734 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:06.768188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:06.768670 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:06.769628 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:06.770053 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:06.920859 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:06.928352 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-da9abb34-f27d-47ef-8719-daf46b97fd86 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.173150 Jun 21 10:06:06.928930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 504/949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:06 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:07.945488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:07.946422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:07.953041 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:07.953490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:07.954266 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:07.954751 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:08.108567 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:08.116779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7aefc2b3-08af-4f79-b101-389bcc892cb9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.174874 Jun 21 10:06:08.117534 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 446/950] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:07 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:09.133927 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:09.134579 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:09.141203 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:09.141690 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:09.142622 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:09.143243 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:09.277295 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:09.284800 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3bb94245-2c4d-471e-9809-c5addd549779 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.155360 Jun 21 10:06:09.285370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 505/951] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:09 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:10.301479 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:10.302612 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:10.309448 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:10.311358 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:10.312111 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:10.312883 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:10.313640 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:10.468883 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:10.478332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f0c61b59-c41d-4700-979b-4ecd8254eccb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1266 microversion: 2.1 time: 0.180871 Jun 21 10:06:10.480606 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 447/952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:10 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:11.495547 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:11.496187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:11.502613 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:11.503065 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:11.503822 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:11.504285 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:11.644247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:11.654139 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-38eabfef-de74-47cb-b9ba-3df37714ada9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1452 microversion: 2.1 time: 0.162692 Jun 21 10:06:11.655523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 506/953] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:11 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:11.671128 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:11.672872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:11.681283 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:11.681955 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:11.682961 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:11.683659 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:11.860585 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:11.878574 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2210c80b-9a53-4f6a-bd9d-f80da79a2992 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1452 microversion: 2.1 time: 0.212136 Jun 21 10:06:11.879139 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 448/954] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:06:11 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:13.526625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-d5e431e2-4982-4df7-bfa2-50a92f4441b1 req-c807b648-b701-4614-bd8a-fd8b45a50ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e618752-2a25-40b4-8c2f-5630d4f18ba4", "tag": "04d5b713-1489-4c7c-a451-3dca2b8d1a52"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:13.536163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-d5e431e2-4982-4df7-bfa2-50a92f4441b1 req-c807b648-b701-4614-bd8a-fd8b45a50ff7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:13.537117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-d5e431e2-4982-4df7-bfa2-50a92f4441b1 req-c807b648-b701-4614-bd8a-fd8b45a50ff7 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:13.551236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-d5e431e2-4982-4df7-bfa2-50a92f4441b1 req-c807b648-b701-4614-bd8a-fd8b45a50ff7 service nova] Creating event network-changed:04d5b713-1489-4c7c-a451-3dca2b8d1a52 for instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 on hv-cinder-80660 Jun 21 10:06:13.566586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-d5e431e2-4982-4df7-bfa2-50a92f4441b1 req-c807b648-b701-4614-bd8a-fd8b45a50ff7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046431 Jun 21 10:06:13.567300 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 507/955] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:24.431839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:24.432789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:24.435270 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:24.435913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=64 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:24.441691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:24.442135 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:24.442901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:24.443333 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:24.625745 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d6b05c75-323b-473e-b12d-e5a9e6369046 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.198274 Jun 21 10:06:24.626212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 449/956] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 21 10:06:24 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516/os-volume_attachments => generated 25 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:06:24.681996 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=25 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:24.682753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=50 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:24.686755 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:24.687345 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:24.694319 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:24.694817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:24.695618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:24.696083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:24.720722 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:06:24.793690 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5762a542-bbd8-42b6-a875-1900d8235c43 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 204 len: 0 microversion: 2.20 time: 0.113643 Jun 21 10:06:24.794270 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 508/957] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 10:06:24 2022] DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:06:24.802568 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:24.803430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:24.809670 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:24.810120 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:24.810882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:24.811317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:24.941583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:24.949494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:24.950980 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:24.952157 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2ea2d270-f5f3-4be9-af20-4aa696964d0a tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.153661 Jun 21 10:06:24.952700 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 450/958] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:24 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:25.971402 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:25.972120 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:25.978987 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:25.979424 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:25.980208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:25.980639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:26.107470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:26.115463 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:26.117281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:26.118433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b79505de-9062-4108-b03d-0dbcd6042699 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.151342 Jun 21 10:06:26.119635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 509/959] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:25 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:27.136924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:27.137536 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:27.144150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:27.144602 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:27.145363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:27.145798 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:27.269265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:27.277180 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:27.278633 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:27.279784 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8a0a8c3e-4da5-4640-9c49-944d3adbeb26 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.147499 Jun 21 10:06:27.280373 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 451/960] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:27 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:28.298209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:28.298808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:28.305304 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:28.305750 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:28.306504 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:28.306935 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:28.436765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:28.444712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:28.446584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:28.448448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c409322f-028e-4ba7-8a7d-b30989724a35 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.154197 Jun 21 10:06:28.449003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 510/961] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:28 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:29.466796 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:29.467404 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:29.473841 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:29.474286 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:29.475035 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:29.475464 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:29.606356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:29.614103 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:29.615581 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:29.617005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-64c1ca2b-d2f1-49ea-9908-4adfab8718f5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.154311 Jun 21 10:06:29.617544 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 452/962] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:29 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:30.635210 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:30.635824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:30.642308 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:30.642763 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:30.643534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:30.643998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:30.784150 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:30.793506 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:30.795012 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:30.796260 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-820f5fcb-14af-4d57-9b65-cead5d2714f0 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1724 microversion: 2.20 time: 0.164947 Jun 21 10:06:30.796813 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 511/963] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:30 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:31.542208 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0d3b9bc0-6aa6-40b0-87d9-55cc6adffe10 req-558372e0-475d-4512-8c08-8f23449ef628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013028d-603c-49de-ad9f-d8f583b1b516", "name": "network-vif-deleted", "tag": "566f28fb-8556-4b14-a4d3-7df74e335933"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:31.551015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d3b9bc0-6aa6-40b0-87d9-55cc6adffe10 req-558372e0-475d-4512-8c08-8f23449ef628 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:31.551394 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d3b9bc0-6aa6-40b0-87d9-55cc6adffe10 req-558372e0-475d-4512-8c08-8f23449ef628 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:31.563871 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0d3b9bc0-6aa6-40b0-87d9-55cc6adffe10 req-558372e0-475d-4512-8c08-8f23449ef628 service nova] Creating event network-vif-deleted:566f28fb-8556-4b14-a4d3-7df74e335933 for instance e013028d-603c-49de-ad9f-d8f583b1b516 on hv-cinder-80660 Jun 21 10:06:31.569195 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0d3b9bc0-6aa6-40b0-87d9-55cc6adffe10 req-558372e0-475d-4512-8c08-8f23449ef628 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030554 Jun 21 10:06:31.569770 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 453/964] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:31.816759 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:31.818019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:31.824806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:31.825282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:31.826236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:31.826677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:31.865338 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:31.865782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:31.866242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lazy-loading 'fault' on Instance uuid e013028d-603c-49de-ad9f-d8f583b1b516 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:06:31.910818 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:31.921168 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:31.922757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf85b80a4bb747da9bd07454536380c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318fe395ab574501973a3a20d0c77bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:06:31.924057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-86307f46-1216-4da8-a6c3-da62a7df1ff5 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 200 len: 1371 microversion: 2.20 time: 0.111673 Jun 21 10:06:31.924808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 512/965] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:31 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:06:32.944464 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:32.945079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:32.952262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:32.952718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:32.953492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:32.953937 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:32.967169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] HTTP exception thrown: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Request method failure captured: Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 HTTP/1.1 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZlrRyWZZMkmDwMrt2OftkZmcx6XnyPhBJQH61KNCg2f--1c0nHPMC7EOTbMofBbb5jO9jfUZ-5N6KtJg-OrBTw5mhowwuEdvLf5DSDB4bugrexkQBWj9wBqQNJWF2Dblye5t7VEHVW81VuabnrYmGsnR0xX7sLMJdOWQI9I-hbi50 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:32.968875 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/318fe395ab574501973a3a20d0c77bfc"}]}] Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: bf85b80a4bb747da9bd07454536380c0 Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:32.970718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e013028d-603c-49de-ad9f-d8f583b1b516'} Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:32.971664 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:32.973274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:32.974750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Returning 404 to user: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:32.974750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-25b41531-88c0-4f33-b288-f1385d6af6ad tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 404 len: 111 microversion: 2.20 time: 0.030661 Jun 21 10:06:32.974750 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 454/966] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:32 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:06:32.979540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-824296e0-8738-420e-8c7f-bd0856ad03c6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '.version_select at 0x7f184af355e0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:32.997062 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-824296e0-8738-420e-8c7f-bd0856ad03c6 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020337206" status: 204 len: 0 microversion: 2.20 time: 0.021820 Jun 21 10:06:32.997607 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 513/967] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Jun 21 10:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020337206 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:06:34.752563 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:34.753072 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:34.764490 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:34.764862 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:34.765634 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:34.766488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:34.780828 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] HTTP exception thrown: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Request method failure captured: Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 HTTP/1.1 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZlrRyWZZMkmDwMrt2OftkZmcx6XnyPhBJQH61KNCg2f--1c0nHPMC7EOTbMofBbb5jO9jfUZ-5N6KtJg-OrBTw5mhowwuEdvLf5DSDB4bugrexkQBWj9wBqQNJWF2Dblye5t7VEHVW81VuabnrYmGsnR0xX7sLMJdOWQI9I-hbi50 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:34.782444 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/318fe395ab574501973a3a20d0c77bfc"}]}] Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: bf85b80a4bb747da9bd07454536380c0 Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.784122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e013028d-603c-49de-ad9f-d8f583b1b516'} Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:34.788197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.790457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.792260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Returning 404 to user: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:34.792260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-944b8447-21c7-422e-af3f-8afb9bd432a1 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 404 len: 111 microversion: 2.20 time: 0.035160 Jun 21 10:06:34.792260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 455/968] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 10:06:34 2022] DELETE /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:06:34.792947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:34.793597 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: e013028d-603c-49de-ad9f-d8f583b1b516] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:34.800312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:34.800705 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:34.801478 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:34.801909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:34.815780 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] HTTP exception thrown: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Request method failure captured: Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 HTTP/1.1 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZlrRyWZZMkmDwMrt2OftkZmcx6XnyPhBJQH61KNCg2f--1c0nHPMC7EOTbMofBbb5jO9jfUZ-5N6KtJg-OrBTw5mhowwuEdvLf5DSDB4bugrexkQBWj9wBqQNJWF2Dblye5t7VEHVW81VuabnrYmGsnR0xX7sLMJdOWQI9I-hbi50 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:06:34.817464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/318fe395ab574501973a3a20d0c77bfc"}]}] Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: bf85b80a4bb747da9bd07454536380c0 Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.819293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'e013028d-603c-49de-ad9f-d8f583b1b516'} Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:34.820222 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. Jun 21 10:06:34.821700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:34.822953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Returning 404 to user: Instance e013028d-603c-49de-ad9f-d8f583b1b516 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:34.822953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-601b6453-5dc0-49b0-a7b0-14a33cc1ebd3 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516" status: 404 len: 111 microversion: 2.20 time: 0.030040 Jun 21 10:06:34.822953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 514/969] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:34 2022] GET /compute/v2.1/servers/e013028d-603c-49de-ad9f-d8f583b1b516 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:06:35.955507 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:35.956290 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:35.965164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:35.966089 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:35.967419 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:35.968074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:35.982049 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] HTTP exception thrown: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Request method failure captured: Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d HTTP/1.1 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZZlrRyWZZMkmDwMrt2OftkZmcx6XnyPhBJQH61KNCg2f--1c0nHPMC7EOTbMofBbb5jO9jfUZ-5N6KtJg-OrBTw5mhowwuEdvLf5DSDB4bugrexkQBWj9wBqQNJWF2Dblye5t7VEHVW81VuabnrYmGsnR0xX7sLMJdOWQI9I-hbi50 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:35.983843 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/318fe395ab574501973a3a20d0c77bfc"}]}] Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: bf85b80a4bb747da9bd07454536380c0 Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:35.985592 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '64e76d7e-1544-4d7d-96d5-6dcca440579d'} Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:35.986459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:35.987950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:35.989441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Returning 404 to user: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:35.989441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f78c1c07-bb1d-49c6-b585-f870c919ca10 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 404 len: 111 microversion: 2.20 time: 0.034625 Jun 21 10:06:35.989441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 456/970] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 21 10:06:35 2022] DELETE /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:06:35.994387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:35.995180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] [instance: 64e76d7e-1544-4d7d-96d5-6dcca440579d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:06:36.003353 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:36.003795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:36.004917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:06:36.005543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:06:36.021800 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] HTTP exception thrown: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Request method failure captured: Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d HTTP/1.1 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZZlrRyWZZMkmDwMrt2OftkZmcx6XnyPhBJQH61KNCg2f--1c0nHPMC7EOTbMofBbb5jO9jfUZ-5N6KtJg-OrBTw5mhowwuEdvLf5DSDB4bugrexkQBWj9wBqQNJWF2Dblye5t7VEHVW81VuabnrYmGsnR0xX7sLMJdOWQI9I-hbi50 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:06:36.023332 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/318fe395ab574501973a3a20d0c77bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/318fe395ab574501973a3a20d0c77bfc"}]}] Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 318fe395ab574501973a3a20d0c77bfc Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-756045864 Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: bf85b80a4bb747da9bd07454536380c0 Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-756045864-project Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:36.024795 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '64e76d7e-1544-4d7d-96d5-6dcca440579d'} Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:36.030307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. Jun 21 10:06:36.032293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:36.033909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] Returning 404 to user: Instance 64e76d7e-1544-4d7d-96d5-6dcca440579d could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:36.033909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1496c579-5997-414b-80d6-3b49ddc72351 tempest-AttachVolumeShelveTestJSON-756045864 tempest-AttachVolumeShelveTestJSON-756045864-project] 10.222.0.36 "GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d" status: 404 len: 111 microversion: 2.20 time: 0.034838 Jun 21 10:06:36.033909 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 515/971] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 21 10:06:35 2022] GET /compute/v2.1/servers/64e76d7e-1544-4d7d-96d5-6dcca440579d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 10:06:40.448625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c475a725-6dfa-4b35-8acc-1db71a93aa43 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Action: 'create', calling method: .version_select at 0x7f184aaf9e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-241671173", "metadata": {"Type": "work"}}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:40.730846 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c475a725-6dfa-4b35-8acc-1db71a93aa43 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.392257 Jun 21 10:06:40.731642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 457/972] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 10:06:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 395 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 10:06:40.743098 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5c2b1f8a-e4cc-435d-8dec-3ff905978813 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Calling method '.version_select at 0x7f184af93a60>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:40.790917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5c2b1f8a-e4cc-435d-8dec-3ff905978813 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d" status: 200 len: 352 microversion: 2.1 time: 0.052088 Jun 21 10:06:40.791486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 516/973] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:06:40 2022] GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:41.803577 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fac3415a-e63c-4938-9635-7030b649aa1a tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Calling method '.version_select at 0x7f184ab3f4c0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:41.857853 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fac3415a-e63c-4938-9635-7030b649aa1a tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d" status: 200 len: 353 microversion: 2.1 time: 0.058414 Jun 21 10:06:41.858427 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 458/974] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:06:41 2022] GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:41.870279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-07763e65-85dd-450c-828c-4f4e342253e8 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Calling method '.version_select at 0x7f185014aaf0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:41.916307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-07763e65-85dd-450c-828c-4f4e342253e8 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d" status: 200 len: 353 microversion: 2.1 time: 0.050524 Jun 21 10:06:41.917019 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 517/975] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:06:41 2022] GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:41.928895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ed68cf4a-f2af-4b4c-8b35-c1c011b1e371 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Calling method '.version_select at 0x7f18500f4d30>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:41.990810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ed68cf4a-f2af-4b4c-8b35-c1c011b1e371 tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d" status: 202 len: 0 microversion: 2.1 time: 0.065648 Jun 21 10:06:41.991362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 459/976] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:06:41 2022] DELETE /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:06:41.999627 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2363829b-c244-4970-883b-74cb73671c6c tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Calling method '.version_select at 0x7f184afdf820>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:42.047516 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2363829b-c244-4970-883b-74cb73671c6c tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d" status: 200 len: 352 microversion: 2.1 time: 0.051627 Jun 21 10:06:42.048113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 518/977] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:06:41 2022] GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:06:43.060797 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8acc61af-7adb-4ded-8ac7-13b242878eea tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Calling method '.version_select at 0x7f184ab125e0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:43.090108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-8acc61af-7adb-4ded-8ac7-13b242878eea tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] HTTP exception thrown: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8acc61af-7adb-4ded-8ac7-13b242878eea tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Request method failure captured: Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d HTTP/1.1 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZgw7scWw4klONSPTR_PFHXGlsl3HPHoiwUQgbHxC2wubc3xZLRHE0M8M7XbnnKASXk_sxBho70YJcPvJnoJSoDuP47VM9vdJeuy12mdLovsl53YmA3aWwbmO4Va3jTrx9ZvPCz_X9Yw0a7muBzYtrUW_wye5zSTB5un1gm9dISRCs0 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: b2ee6b4499724018b2145752014e1330 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesGetTestJSON-776430722 Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:43.092074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2ee6b4499724018b2145752014e1330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2ee6b4499724018b2145752014e1330"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2ee6b4499724018b2145752014e1330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2ee6b4499724018b2145752014e1330"}]}] Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesGetTestJSON-776430722 Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: b2ee6b4499724018b2145752014e1330 Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesGetTestJSON-776430722 Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesGetTestJSON-776430722-project Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 5ceaeb1a3ec54e998429d4dacfd2aaaf Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesGetTestJSON-776430722-project Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '9ca0ac4d-ce04-4673-8003-51f5dd71bd5d'} Jun 21 10:06:43.093795 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. (HTTP 404) (Request-ID: req-29544e3f-1db3-42f1-8b32-42b148fa896c) Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:43.094897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:06:43.096716 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:06:43.098314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. Jun 21 10:06:43.099787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:43.103959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8acc61af-7adb-4ded-8ac7-13b242878eea tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] Returning 404 to user: Volume 9ca0ac4d-ce04-4673-8003-51f5dd71bd5d could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:43.103959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8acc61af-7adb-4ded-8ac7-13b242878eea tempest-VolumesGetTestJSON-776430722 tempest-VolumesGetTestJSON-776430722-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d" status: 404 len: 109 microversion: 2.1 time: 0.046781 Jun 21 10:06:43.103959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 460/978] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:06:43 2022] GET /compute/v2.1/os-volumes/9ca0ac4d-ce04-4673-8003-51f5dd71bd5d => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:06:44.529668 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8c716fe-3974-429c-8e56-03f01f40d573 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Action: 'create', calling method: .version_select at 0x7f18534f8c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1248131782", "metadata": {"Type": "work"}}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8c716fe-3974-429c-8e56-03f01f40d573 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Request method failure captured: Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 122 Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZg023Cl9WQwXpKYEVsrDKrTlr2Ag9ER3J4WSb980IltwXphLp2Thuwxx7puFapa-zgBlQKr63hcTI1Gs3JlHR-_sfuoIvN4xk-RSz_2GsOrAYZOGCpET068vZMj3RfHIJtEapn1VVjtx5CGXMqSvsC8wbG---mlbP0xtIitLbo8TaQ Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:06:44.547091 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa24ecda9f3d47d5bab96ff9aaa98653"}]}] Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: b6429d701366473889a338b18408d7ae Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1248131782", "metadata": {"Type": "work"}}} Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: Jun 21 10:06:44.548853 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1248131782', 'metadata': {'Type': 'work'}}}} Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise error Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:44.549847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 10:06:44.551523 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 10:06:44.553123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 10:06:44.553123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.553123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a8c716fe-3974-429c-8e56-03f01f40d573 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:44.553123 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a8c716fe-3974-429c-8e56-03f01f40d573 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.159403 Jun 21 10:06:44.553726 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 519/979] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 10:06:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:06:44.560160 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e0d89f27-b1ea-403f-9498-03822fdda191 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Action: 'create', calling method: .version_select at 0x7f184ab12dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-349246031", "metadata": {"Type": "work"}}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e0d89f27-b1ea-403f-9498-03822fdda191 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Request method failure captured: Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 119 Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZg023Cl9WQwXpKYEVsrDKrTlr2Ag9ER3J4WSb980IltwXphLp2Thuwxx7puFapa-zgBlQKr63hcTI1Gs3JlHR-_sfuoIvN4xk-RSz_2GsOrAYZOGCpET068vZMj3RfHIJtEapn1VVjtx5CGXMqSvsC8wbG---mlbP0xtIitLbo8TaQ Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:44.563538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa24ecda9f3d47d5bab96ff9aaa98653"}]}] Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: b6429d701366473889a338b18408d7ae Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-349246031", "metadata": {"Type": "work"}}} Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: Jun 21 10:06:44.565206 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-349246031', 'metadata': {'Type': 'work'}}}} Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise error Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi '0' Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:44.566440 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 10:06:44.569588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 10:06:44.571078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 10:06:44.571078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.571078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e0d89f27-b1ea-403f-9498-03822fdda191 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:44.571078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e0d89f27-b1ea-403f-9498-03822fdda191 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010252 Jun 21 10:06:44.571078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 461/980] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 10:06:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 10:06:44.578267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-254ad89b-802a-4284-a260-253a5cfaaf75 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Action: 'create', calling method: .version_select at 0x7f184aec0820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936096359", "metadata": {"Type": "work"}}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-254ad89b-802a-4284-a260-253a5cfaaf75 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Request method failure captured: Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 119 Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZg023Cl9WQwXpKYEVsrDKrTlr2Ag9ER3J4WSb980IltwXphLp2Thuwxx7puFapa-zgBlQKr63hcTI1Gs3JlHR-_sfuoIvN4xk-RSz_2GsOrAYZOGCpET068vZMj3RfHIJtEapn1VVjtx5CGXMqSvsC8wbG---mlbP0xtIitLbo8TaQ Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:06:44.580833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa24ecda9f3d47d5bab96ff9aaa98653"}]}] Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: b6429d701366473889a338b18408d7ae Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936096359", "metadata": {"Type": "work"}}} Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: Jun 21 10:06:44.582584 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1936096359', 'metadata': {'Type': 'work'}}}} Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise error Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi '' Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:44.583824 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 10:06:44.585512 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 10:06:44.586702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 10:06:44.586702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.586702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-254ad89b-802a-4284-a260-253a5cfaaf75 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:44.586702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-254ad89b-802a-4284-a260-253a5cfaaf75 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011086 Jun 21 10:06:44.586702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 520/981] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 21 10:06:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:06:44.592830 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eccdb9e6-1933-4275-8376-32ef6eed0cf5 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Calling method '.version_select at 0x7f184ab334c0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:44.622494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-eccdb9e6-1933-4275-8376-32ef6eed0cf5 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] HTTP exception thrown: Volume tempest-invalid-463630495 could not be found. Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eccdb9e6-1933-4275-8376-32ef6eed0cf5 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Request method failure captured: Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-463630495 HTTP/1.1 Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZg023Cl9WQwXpKYEVsrDKrTlr2Ag9ER3J4WSb980IltwXphLp2Thuwxx7puFapa-zgBlQKr63hcTI1Gs3JlHR-_sfuoIvN4xk-RSz_2GsOrAYZOGCpET068vZMj3RfHIJtEapn1VVjtx5CGXMqSvsC8wbG---mlbP0xtIitLbo8TaQ Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:44.624465 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa24ecda9f3d47d5bab96ff9aaa98653"}]}] Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: b6429d701366473889a338b18408d7ae Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Volume tempest-invalid-463630495 could not be found. Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'tempest-invalid-463630495'} Jun 21 10:06:44.625887 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-463630495 could not be found. (HTTP 404) (Request-ID: req-4ecf7da6-01cc-4a15-aa58-a98bdd9cd384) Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.626714 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:06:44.627905 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-463630495 could not be found. Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:44.629162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-463630495 could not be found. Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-463630495 could not be found. Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eccdb9e6-1933-4275-8376-32ef6eed0cf5 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Returning 404 to user: Volume tempest-invalid-463630495 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eccdb9e6-1933-4275-8376-32ef6eed0cf5 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-463630495" status: 404 len: 98 microversion: 2.1 time: 0.037572 Jun 21 10:06:44.630530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 462/982] 10.222.0.36 () {58 vars in 1214 bytes} [Tue Jun 21 10:06:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-463630495 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 10:06:44.636287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5d5eafbf-dca7-4740-bb4e-e89397867f64 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003657 Jun 21 10:06:44.636787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 521/983] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jun 21 10:06:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 10:06:44.647038 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cfe7d9cd-94e6-48cc-a250-866f430b6005 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004768 Jun 21 10:06:44.651573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 463/984] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Jun 21 10:06:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 10:06:44.656866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee9bc5bc-cb10-47ce-8cf3-3be9fca404e7 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Calling method '.version_select at 0x7f184abf6790>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:44.686679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-ee9bc5bc-cb10-47ce-8cf3-3be9fca404e7 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] HTTP exception thrown: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee9bc5bc-cb10-47ce-8cf3-3be9fca404e7 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Request method failure captured: Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/os-volumes/96aed5e3-875a-479c-b133-8156a540f398 HTTP/1.1 Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZg023Cl9WQwXpKYEVsrDKrTlr2Ag9ER3J4WSb980IltwXphLp2Thuwxx7puFapa-zgBlQKr63hcTI1Gs3JlHR-_sfuoIvN4xk-RSz_2GsOrAYZOGCpET068vZMj3RfHIJtEapn1VVjtx5CGXMqSvsC8wbG---mlbP0xtIitLbo8TaQ Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:06:44.688652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa24ecda9f3d47d5bab96ff9aaa98653"}]}] Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: b6429d701366473889a338b18408d7ae Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '96aed5e3-875a-479c-b133-8156a540f398'} Jun 21 10:06:44.690057 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. (HTTP 404) (Request-ID: req-78c91626-a999-452c-9646-a1c4a63fe8c2) Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.692697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:06:44.693877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 10:06:44.695163 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee9bc5bc-cb10-47ce-8cf3-3be9fca404e7 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Returning 404 to user: Volume 96aed5e3-875a-479c-b133-8156a540f398 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ee9bc5bc-cb10-47ce-8cf3-3be9fca404e7 tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/96aed5e3-875a-479c-b133-8156a540f398" status: 404 len: 109 microversion: 2.1 time: 0.037288 Jun 21 10:06:44.696679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 522/985] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 21 10:06:44 2022] DELETE /compute/v2.1/os-volumes/96aed5e3-875a-479c-b133-8156a540f398 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:06:44.701695 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04ca3bb1-58e4-4cc8-b1b0-fe983be84ecc tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Calling method '.version_select at 0x7f184ab330d0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:06:44.733074 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-04ca3bb1-58e4-4cc8-b1b0-fe983be84ecc tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] HTTP exception thrown: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04ca3bb1-58e4-4cc8-b1b0-fe983be84ecc tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Request method failure captured: Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/os-volumes/f6542903-74ca-435e-97f5-bcddd5d8d91b HTTP/1.1 Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZg023Cl9WQwXpKYEVsrDKrTlr2Ag9ER3J4WSb980IltwXphLp2Thuwxx7puFapa-zgBlQKr63hcTI1Gs3JlHR-_sfuoIvN4xk-RSz_2GsOrAYZOGCpET068vZMj3RfHIJtEapn1VVjtx5CGXMqSvsC8wbG---mlbP0xtIitLbo8TaQ Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:06:44.735218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa24ecda9f3d47d5bab96ff9aaa98653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa24ecda9f3d47d5bab96ff9aaa98653"}]}] Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: fa24ecda9f3d47d5bab96ff9aaa98653 Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1915349015 Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: b6429d701366473889a338b18408d7ae Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1915349015-project Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'f6542903-74ca-435e-97f5-bcddd5d8d91b'} Jun 21 10:06:44.737701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. (HTTP 404) (Request-ID: req-5cd86708-2f77-495c-b3d2-e92ab1cc67cc) Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.739070 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:06:44.741315 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:06:44.743916 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04ca3bb1-58e4-4cc8-b1b0-fe983be84ecc tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] Returning 404 to user: Volume f6542903-74ca-435e-97f5-bcddd5d8d91b could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-04ca3bb1-58e4-4cc8-b1b0-fe983be84ecc tempest-VolumesNegativeTest-1915349015 tempest-VolumesNegativeTest-1915349015-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6542903-74ca-435e-97f5-bcddd5d8d91b" status: 404 len: 109 microversion: 2.1 time: 0.039616 Jun 21 10:06:44.747036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 464/986] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 21 10:06:44 2022] GET /compute/v2.1/os-volumes/f6542903-74ca-435e-97f5-bcddd5d8d91b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:07:00.091387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-836089790", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "networks": [{"uuid": "a4394e48-c16f-4ad3-a971-ada9914ba22f"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:00.102382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:00.103380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:00.171282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] validate_networks() for [('a4394e48-c16f-4ad3-a971-ada9914ba22f', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:07:00.539891 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:07:00.540349 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:07:00.540828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:07:00.541268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:07:00.541684 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:07:00.551060 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:00.551517 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:00.552351 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:00.552810 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:00.569214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Getting quotas for project c8158e0b793e4ab39eb46f57cd27fda3. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:07:00.573212 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Getting quotas for user 9d071700ef004aa88715e0efa8915d6f and project c8158e0b793e4ab39eb46f57cd27fda3. Resources: {'cores', 'instances', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:07:00.585624 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:07:00.587932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:07:00.634606 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5ae92588-a884-4cf2-b35b-a70635ca6f7b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548432 Jun 21 10:07:00.635489 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 523/987] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:07:00.643223 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=16 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:00.643997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=32 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:00.647731 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-42bf87ea-3cd8-4fde-a08d-1493784f24e3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:00.648362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-42bf87ea-3cd8-4fde-a08d-1493784f24e3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:00.707912 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-42bf87ea-3cd8-4fde-a08d-1493784f24e3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:00.714752 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-42bf87ea-3cd8-4fde-a08d-1493784f24e3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1213 microversion: 2.1 time: 0.072911 Jun 21 10:07:00.715363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 465/988] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:00 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:01.732869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:01.734343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:01.743219 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:01.743697 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:01.744817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:01.745413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:01.809586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:01.819138 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0a17dd9a-4ffe-4cea-81dc-092e5d23d41e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1283 microversion: 2.1 time: 0.091233 Jun 21 10:07:01.819706 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 524/989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:01 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:02.837455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:02.838000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:02.844341 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:02.844789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:02.845557 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:02.845990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:03.048889 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:03.057068 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-564ee91b-a94b-458c-9a2c-c1439b8fb0f3 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.223673 Jun 21 10:07:03.066973 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 466/990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:02 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:03.074675 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-4afd1916-b1e5-414c-8a0e-148c4493e027 req-306b8cd5-1bf7-437a-bbbf-3712b1504dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94edb611-d001-4606-b5c7-e083f8e767bf", "tag": "e4251cd9-ec96-48e6-9114-e8c293f41b2b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:03.085872 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-4afd1916-b1e5-414c-8a0e-148c4493e027 req-306b8cd5-1bf7-437a-bbbf-3712b1504dfd service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:03.086752 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-4afd1916-b1e5-414c-8a0e-148c4493e027 req-306b8cd5-1bf7-437a-bbbf-3712b1504dfd service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:03.106415 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-4afd1916-b1e5-414c-8a0e-148c4493e027 req-306b8cd5-1bf7-437a-bbbf-3712b1504dfd service nova] Creating event network-changed:e4251cd9-ec96-48e6-9114-e8c293f41b2b for instance 94edb611-d001-4606-b5c7-e083f8e767bf on hv-cinder-80660 Jun 21 10:07:03.111448 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-4afd1916-b1e5-414c-8a0e-148c4493e027 req-306b8cd5-1bf7-437a-bbbf-3712b1504dfd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043338 Jun 21 10:07:03.112159 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 525/991] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:04.074281 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:04.074929 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:04.081368 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:04.081823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:04.082582 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:04.083022 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:04.209673 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:04.217075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-916137bc-ad0d-4c13-ae05-a811d480c342 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.146713 Jun 21 10:07:04.217663 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 467/992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:04 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:05.234475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:05.235313 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:05.241370 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:05.241817 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:05.242828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:05.243265 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:05.382829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:05.391895 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9e531ae2-4d62-473c-9746-f9e434f0dc01 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.161923 Jun 21 10:07:05.392641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 526/993] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:05 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:06.410263 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:06.410882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:06.417447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:06.417898 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:06.419179 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:06.419614 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:06.548037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:06.555362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f53f9ed8-5ffc-4adb-a8ad-89bcd5863ec0 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.149421 Jun 21 10:07:06.556037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 468/994] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:06 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:07.572377 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:07.573101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:07.580495 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:07.580943 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:07.581712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:07.582145 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:07.796359 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:07.806237 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9eec5b34-d324-49da-938b-883a3220153e tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.237612 Jun 21 10:07:07.806803 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 527/995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:07 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:08.594906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-ad030b7c-7311-4a8f-bd03-aae6121bc090 req-923fa839-a680-442a-ac21-97f0cc91517f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94edb611-d001-4606-b5c7-e083f8e767bf", "name": "network-vif-plugged", "status": "completed", "tag": "e4251cd9-ec96-48e6-9114-e8c293f41b2b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:08.606614 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ad030b7c-7311-4a8f-bd03-aae6121bc090 req-923fa839-a680-442a-ac21-97f0cc91517f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:08.607068 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ad030b7c-7311-4a8f-bd03-aae6121bc090 req-923fa839-a680-442a-ac21-97f0cc91517f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:08.619248 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-ad030b7c-7311-4a8f-bd03-aae6121bc090 req-923fa839-a680-442a-ac21-97f0cc91517f service nova] Creating event network-vif-plugged:e4251cd9-ec96-48e6-9114-e8c293f41b2b for instance 94edb611-d001-4606-b5c7-e083f8e767bf on hv-cinder-80660 Jun 21 10:07:08.624986 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-ad030b7c-7311-4a8f-bd03-aae6121bc090 req-923fa839-a680-442a-ac21-97f0cc91517f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035010 Jun 21 10:07:08.626129 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 469/996] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:08.823443 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:08.824724 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:08.832966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:08.833423 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:08.834209 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:08.834669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:09.004261 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:09.011619 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ae598264-3c11-43ac-82a9-6d2ccab5d218 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.192016 Jun 21 10:07:09.012208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 528/997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:08 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:10.033091 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:10.033872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:10.040508 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:10.041036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:10.041785 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:10.042218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:10.177653 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:10.185848 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bb2a5670-0db1-4f8a-ad4f-9339c080ef3b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1313 microversion: 2.1 time: 0.157734 Jun 21 10:07:10.186541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 470/998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:10 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:11.202812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:11.203414 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:11.205933 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:11.206960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:11.212215 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:11.212725 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:11.213513 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:11.213953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:11.356371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:11.363808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1aab65d6-541d-446f-bd69-d5de44c7b6fa tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1497 microversion: 2.1 time: 0.165529 Jun 21 10:07:11.364433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 529/999] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:11 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:11.924317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:11.924817 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:11.926872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:11.932476 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:11.932920 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:11.933708 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:11.934141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:11.960326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:07:12.031691 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f10ca12a-6016-4dcc-9df9-576205c68f9b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "DELETE /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 204 len: 0 microversion: 2.1 time: 0.110676 Jun 21 10:07:12.032318 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 471/1000] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:07:11 2022] DELETE /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:07:12.041046 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:12.041661 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:12.048296 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:12.048746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:12.049508 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:12.049952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:12.178096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:12.185526 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2e660db4-2cdf-46fe-893b-1e0f15f6c3e8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1503 microversion: 2.1 time: 0.148533 Jun 21 10:07:12.186102 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 530/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:12 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:13.203380 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:13.204096 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:13.210539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:13.210984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:13.211739 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:13.212197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:13.337403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:13.345345 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-245afb6b-c2d1-4fc6-a479-fdc15eab4875 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1503 microversion: 2.1 time: 0.146713 Jun 21 10:07:13.345892 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 472/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:13 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:14.353267 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-289c42c9-ebde-4ccc-bf96-4ba2def79828 req-87bb601b-6532-4330-b955-9ad42dc1c155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94edb611-d001-4606-b5c7-e083f8e767bf", "name": "network-vif-deleted", "tag": "e4251cd9-ec96-48e6-9114-e8c293f41b2b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:14.366748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-289c42c9-ebde-4ccc-bf96-4ba2def79828 req-87bb601b-6532-4330-b955-9ad42dc1c155 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:14.367413 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-289c42c9-ebde-4ccc-bf96-4ba2def79828 req-87bb601b-6532-4330-b955-9ad42dc1c155 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:14.369063 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:14.369779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:14.379533 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:14.380002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:14.380943 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:14.381387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:14.383313 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-289c42c9-ebde-4ccc-bf96-4ba2def79828 req-87bb601b-6532-4330-b955-9ad42dc1c155 service nova] Creating event network-vif-deleted:e4251cd9-ec96-48e6-9114-e8c293f41b2b for instance 94edb611-d001-4606-b5c7-e083f8e767bf on hv-cinder-80660 Jun 21 10:07:14.391963 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-289c42c9-ebde-4ccc-bf96-4ba2def79828 req-87bb601b-6532-4330-b955-9ad42dc1c155 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042494 Jun 21 10:07:14.393003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 531/1003] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:14.466152 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:14.474901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7cb1e2a1-0b8e-4a5f-871b-89b4516b13b7 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 200 len: 1461 microversion: 2.1 time: 0.110790 Jun 21 10:07:14.475519 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 473/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:14 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 1461 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:15.493677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:15.494493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: 94edb611-d001-4606-b5c7-e083f8e767bf] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:15.500723 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:15.501247 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:15.502585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:15.503114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:15.516623 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] HTTP exception thrown: Instance 94edb611-d001-4606-b5c7-e083f8e767bf could not be found. Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Request method failure captured: Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf HTTP/1.1 Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZhCI-H0zAK3Bze3eTjSwe90Xt1bPHNlK-A6Zp9Bt__WFlZ6HyD57g9-LBKNFK4aEKXnhQ_pjhVv-pAQxlIRux8RcikFpSSk51QVyJhW3v1HCGtBiosYMlhZCtB0KGCzQxRYdznrTjFoJDFTTkQi1EOwu3VfI2nCPTnWOnM1G5dVIEA Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: c8158e0b793e4ab39eb46f57cd27fda3 Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesActionsTest-1874156397 Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:07:15.518648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8158e0b793e4ab39eb46f57cd27fda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8158e0b793e4ab39eb46f57cd27fda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8158e0b793e4ab39eb46f57cd27fda3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8158e0b793e4ab39eb46f57cd27fda3"}]}] Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesActionsTest-1874156397 Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c8158e0b793e4ab39eb46f57cd27fda3 Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesActionsTest-1874156397 Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesActionsTest-1874156397-project Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 9d071700ef004aa88715e0efa8915d6f Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesActionsTest-1874156397-project Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance 94edb611-d001-4606-b5c7-e083f8e767bf could not be found. Jun 21 10:07:15.520434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': '94edb611-d001-4606-b5c7-e083f8e767bf'} Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94edb611-d001-4606-b5c7-e083f8e767bf could not be found. Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:07:15.521453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94edb611-d001-4606-b5c7-e083f8e767bf could not be found. Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94edb611-d001-4606-b5c7-e083f8e767bf could not be found. Jun 21 10:07:15.522905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:15.524144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Returning 404 to user: Instance 94edb611-d001-4606-b5c7-e083f8e767bf could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:07:15.524144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-189fb7f4-68ff-4e71-a1ed-b61e76d4a48f tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf" status: 404 len: 111 microversion: 2.1 time: 0.031457 Jun 21 10:07:15.524144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 532/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:15 2022] GET /compute/v2.1/servers/94edb611-d001-4606-b5c7-e083f8e767bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:07:15.626037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-717151774", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452", "networks": [{"uuid": "a4394e48-c16f-4ad3-a971-ada9914ba22f"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:15.678192 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] validate_networks() for [('a4394e48-c16f-4ad3-a971-ada9914ba22f', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:07:16.038350 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:07:16.038781 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:07:16.039287 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:07:16.039697 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:07:16.040142 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:07:16.049312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:16.049829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:16.050672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:16.051114 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:16.068494 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Getting quotas for project c8158e0b793e4ab39eb46f57cd27fda3. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:07:16.072610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Getting quotas for user 9d071700ef004aa88715e0efa8915d6f and project c8158e0b793e4ab39eb46f57cd27fda3. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:07:16.084804 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:07:16.087165 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:07:16.134950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-450f9ee6-6a9f-4c5a-88ab-bd87980803c8 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512616 Jun 21 10:07:16.135913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 474/1006] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:07:16.149591 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-42271dff-10fc-496a-be0c-a3e06988a7e9 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:16.150906 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-42271dff-10fc-496a-be0c-a3e06988a7e9 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:16.214096 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-42271dff-10fc-496a-be0c-a3e06988a7e9 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:16.223176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-42271dff-10fc-496a-be0c-a3e06988a7e9 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1213 microversion: 2.1 time: 0.079264 Jun 21 10:07:16.224201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 533/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:16 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:17.239621 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:17.240262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:17.250205 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:17.250653 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:17.253384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:17.254020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:17.352712 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:17.363461 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-75985f34-506c-4a60-9f8d-21bf26283141 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1273 microversion: 2.1 time: 0.127549 Jun 21 10:07:17.364062 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 475/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:17 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:18.383679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:18.385649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:18.394997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:18.396494 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:18.397532 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:18.398743 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:18.700830 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:18.714833 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b014cde2-fafc-4d66-a689-9b6e5c5622d5 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.337686 Jun 21 10:07:18.715728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 534/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:18 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:18.819402 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0d14ef15-4018-4a50-8bc1-9b702fcd4ccd req-8c586148-0203-4f6c-8f02-64d787192818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9002f2-8896-4433-a424-7a11fcf8f974", "tag": "f23eb134-e269-4683-85db-f1882ee49434"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:18.844154 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d14ef15-4018-4a50-8bc1-9b702fcd4ccd req-8c586148-0203-4f6c-8f02-64d787192818 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:18.844829 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d14ef15-4018-4a50-8bc1-9b702fcd4ccd req-8c586148-0203-4f6c-8f02-64d787192818 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:18.859693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0d14ef15-4018-4a50-8bc1-9b702fcd4ccd req-8c586148-0203-4f6c-8f02-64d787192818 service nova] Creating event network-changed:f23eb134-e269-4683-85db-f1882ee49434 for instance ca9002f2-8896-4433-a424-7a11fcf8f974 on hv-cinder-80660 Jun 21 10:07:18.868803 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0d14ef15-4018-4a50-8bc1-9b702fcd4ccd req-8c586148-0203-4f6c-8f02-64d787192818 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055141 Jun 21 10:07:18.870162 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 476/1010] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:19.733226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:19.733932 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:19.740869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:19.741586 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:19.742888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:19.743592 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:19.953144 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:19.962115 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-971da8c2-acf4-418e-a1a9-12a9f5490d98 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.233180 Jun 21 10:07:19.964492 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 535/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:19 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:20.981999 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:20.982707 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:20.989597 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:20.990002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:20.990783 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:20.991226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:21.154539 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:21.165364 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-67e7ba91-31d7-439a-8a79-632e67acc890 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.188268 Jun 21 10:07:21.166780 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 477/1012] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:20 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:22.183563 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:22.184381 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:22.191774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:22.192391 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:22.193333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:22.193835 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:22.346200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:22.355482 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6a7847b8-f6fc-479f-9233-9e34f1e1dead tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.176530 Jun 21 10:07:22.356326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 536/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:22 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:23.373451 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:23.375470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:23.383025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:23.383818 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:23.384869 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:23.385501 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:23.623924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:23.634991 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9ba0ac8d-ec70-45ba-b8dc-fcd1d9b16943 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.265971 Jun 21 10:07:23.636020 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 478/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:23 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:24.652200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:24.653513 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:24.661201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:24.662660 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:24.663649 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:24.664283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:25.038515 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:25.051464 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1e25d9a3-6ff7-4803-aac4-1f0a2615f2bf tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.402963 Jun 21 10:07:25.052090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 537/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:24 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:25.109775 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-477eaf49-4b49-42f6-b29c-9ceb24b8299a req-f4d09f3e-9784-4857-98bc-4947128c992b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9002f2-8896-4433-a424-7a11fcf8f974", "name": "network-vif-plugged", "status": "completed", "tag": "f23eb134-e269-4683-85db-f1882ee49434"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:25.127903 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-477eaf49-4b49-42f6-b29c-9ceb24b8299a req-f4d09f3e-9784-4857-98bc-4947128c992b service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:25.128901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-477eaf49-4b49-42f6-b29c-9ceb24b8299a req-f4d09f3e-9784-4857-98bc-4947128c992b service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:25.165218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-477eaf49-4b49-42f6-b29c-9ceb24b8299a req-f4d09f3e-9784-4857-98bc-4947128c992b service nova] Creating event network-vif-plugged:f23eb134-e269-4683-85db-f1882ee49434 for instance ca9002f2-8896-4433-a424-7a11fcf8f974 on hv-cinder-80660 Jun 21 10:07:25.182747 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-477eaf49-4b49-42f6-b29c-9ceb24b8299a req-f4d09f3e-9784-4857-98bc-4947128c992b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101113 Jun 21 10:07:25.186085 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 479/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:26.069976 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:26.071194 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:26.084319 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:26.090929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:26.095723 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:26.097639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:26.222921 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:26.551843 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:26.561008 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-09d3bb17-96f1-46b4-a8a1-7cc1b5309d43 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1313 microversion: 2.1 time: 0.495978 Jun 21 10:07:26.561588 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 538/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:26 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:26.630888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:26.632169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:26.801025 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-baa79bdb-3882-4817-b36f-06de1f0ba074 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Action: 'create', calling method: .version_select at 0x7f184aa63430>, body: {"keypair": {"name": "tempest-TestShelveInstance-993543605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKZDhOe+sjN0sNJv3QSvFhurVZ4LrP02HKCH/+oOo0Kzol0J41ZdY+V1iNJAtjn4KXj8PJofpiZT9QLlpfbqtsfoddC5JLdML2pKuJCEiI7hJgODX7uN663rSS4j09d+w=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:26.815198 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-baa79bdb-3882-4817-b36f-06de1f0ba074 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Getting quotas for project dff115ce08e947c29313f5019cf568fd. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:07:26.819158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-baa79bdb-3882-4817-b36f-06de1f0ba074 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Getting quotas for user 9f42593700cb41408d258257c652f5b7 and project dff115ce08e947c29313f5019cf568fd. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:07:26.844516 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-baa79bdb-3882-4817-b36f-06de1f0ba074 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.218282 Jun 21 10:07:26.845108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 480/1018] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 21 10:07:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:27.578263 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:27.578807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:27.586239 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:27.586703 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:27.587486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:27.587926 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:27.781659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:27.789746 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cb52340e-bda5-433e-befe-0fde451eecd1 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1497 microversion: 2.1 time: 0.215815 Jun 21 10:07:27.790555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 539/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:27 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:28.335878 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:28.336698 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:28.348259 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:28.349347 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:28.350330 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:28.350771 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:28.377457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:07:28.461897 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4db0533d-eec3-41aa-bb2e-b9da1014c340 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 204 len: 0 microversion: 2.1 time: 0.130165 Jun 21 10:07:28.463240 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 481/1020] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:07:28 2022] DELETE /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:07:28.473197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:28.474278 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:28.480362 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:28.481587 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:28.482359 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:28.482790 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:28.618194 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:28.625790 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-180d6b97-2072-4f12-b520-dfbf37adc415 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1503 microversion: 2.1 time: 0.157706 Jun 21 10:07:28.626347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 540/1021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:28 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:07:29.643384 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:29.644102 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:29.650546 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:29.651075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:29.651894 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:29.652534 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:29.801735 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:29.805499 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:29.811332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cb2cc777-6118-44bd-afc9-2cdf0402ae40 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1503 microversion: 2.1 time: 0.172055 Jun 21 10:07:29.811900 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 482/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:29 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:30.642185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-2154c4ff-45c4-4346-920b-faa5e79fb6d8 req-b735dcb9-f40d-4e89-a0b7-6e83ee7f50c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9002f2-8896-4433-a424-7a11fcf8f974", "name": "network-vif-deleted", "tag": "f23eb134-e269-4683-85db-f1882ee49434"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:30.647618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:30.654812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-2154c4ff-45c4-4346-920b-faa5e79fb6d8 req-b735dcb9-f40d-4e89-a0b7-6e83ee7f50c3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:30.655271 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-2154c4ff-45c4-4346-920b-faa5e79fb6d8 req-b735dcb9-f40d-4e89-a0b7-6e83ee7f50c3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:30.658250 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=87 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:30.667934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-2154c4ff-45c4-4346-920b-faa5e79fb6d8 req-b735dcb9-f40d-4e89-a0b7-6e83ee7f50c3 service nova] Creating event network-vif-deleted:f23eb134-e269-4683-85db-f1882ee49434 for instance ca9002f2-8896-4433-a424-7a11fcf8f974 on hv-cinder-80660 Jun 21 10:07:30.674119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-2154c4ff-45c4-4346-920b-faa5e79fb6d8 req-b735dcb9-f40d-4e89-a0b7-6e83ee7f50c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036233 Jun 21 10:07:30.675392 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 541/1023] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:07:30.829075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:30.829794 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:30.832148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:30.839040 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:30.839480 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:30.840265 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:30.840702 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:30.874363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:30.874810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:30.875262 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lazy-loading 'fault' on Instance uuid ca9002f2-8896-4433-a424-7a11fcf8f974 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:07:30.918093 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d071700ef004aa88715e0efa8915d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8158e0b793e4ab39eb46f57cd27fda3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:30.925980 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a8d9d8b6-50fb-46df-acf5-5c012369275b tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 200 len: 1303 microversion: 2.1 time: 0.101921 Jun 21 10:07:30.926483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 483/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:30 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:31.944524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:31.945242 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] [instance: ca9002f2-8896-4433-a424-7a11fcf8f974] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:31.952433 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:31.952885 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:31.953659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:31.954093 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:31.967750 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] HTTP exception thrown: Instance ca9002f2-8896-4433-a424-7a11fcf8f974 could not be found. Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Request method failure captured: Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 HTTP/1.1 Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZhCI-H0zAK3Bze3eTjSwe90Xt1bPHNlK-A6Zp9Bt__WFlZ6HyD57g9-LBKNFK4aEKXnhQ_pjhVv-pAQxlIRux8RcikFpSSk51QVyJhW3v1HCGtBiosYMlhZCtB0KGCzQxRYdznrTjFoJDFTTkQi1EOwu3VfI2nCPTnWOnM1G5dVIEA Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: c8158e0b793e4ab39eb46f57cd27fda3 Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesActionsTest-1874156397 Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:07:31.969411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8158e0b793e4ab39eb46f57cd27fda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8158e0b793e4ab39eb46f57cd27fda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8158e0b793e4ab39eb46f57cd27fda3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8158e0b793e4ab39eb46f57cd27fda3"}]}] Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesActionsTest-1874156397 Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c8158e0b793e4ab39eb46f57cd27fda3 Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesActionsTest-1874156397 Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesActionsTest-1874156397-project Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 9d071700ef004aa88715e0efa8915d6f Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesActionsTest-1874156397-project Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance ca9002f2-8896-4433-a424-7a11fcf8f974 could not be found. Jun 21 10:07:31.971434 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'ca9002f2-8896-4433-a424-7a11fcf8f974'} Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9002f2-8896-4433-a424-7a11fcf8f974 could not be found. Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:07:31.972461 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9002f2-8896-4433-a424-7a11fcf8f974 could not be found. Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9002f2-8896-4433-a424-7a11fcf8f974 could not be found. Jun 21 10:07:31.974034 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:07:31.975372 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] Returning 404 to user: Instance ca9002f2-8896-4433-a424-7a11fcf8f974 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:07:31.975372 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1d9c01a8-bda9-49b3-a938-87970ec11f51 tempest-VolumesActionsTest-1874156397 tempest-VolumesActionsTest-1874156397-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974" status: 404 len: 111 microversion: 2.1 time: 0.031331 Jun 21 10:07:31.975372 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 542/1025] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:31 2022] GET /compute/v2.1/servers/ca9002f2-8896-4433-a424-7a11fcf8f974 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:07:45.204414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1280397075", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-993543605", "security_groups": [{"name": "tempest-secgroup-smoke-247099568"}], "networks": [{"uuid": "09348762-66bf-4cd0-bfb0-35af09ed6914"}], "block_device_mapping_v2": [{"uuid": "dd6c41fe-564c-4ed2-971a-6fcbd02da5db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:45.221666 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:45.222773 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:45.223560 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=8 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:45.353166 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] validate_networks() for [('09348762-66bf-4cd0-bfb0-35af09ed6914', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:07:45.786431 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:07:45.786892 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:07:45.787445 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:07:45.787863 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:07:45.788421 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:07:45.806891 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:45.807336 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:45.808365 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:45.808827 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:45.830107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Getting quotas for project dff115ce08e947c29313f5019cf568fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:07:45.835222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Getting quotas for user 9f42593700cb41408d258257c652f5b7 and project dff115ce08e947c29313f5019cf568fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:07:45.915462 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:07:45.918009 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd6c41fe-564c-4ed2-971a-6fcbd02da5db',volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:07:46.079150 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-daf7bde9-a345-4eff-adfb-2815dad8a5ca tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.879111 Jun 21 10:07:46.080255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 484/1026] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:07:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:07:46.091719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c9457c11-0a37-4fb9-a8fa-d4f8a8cfd85a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:46.093593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c9457c11-0a37-4fb9-a8fa-d4f8a8cfd85a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:46.104077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:46.105268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:46.182416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c9457c11-0a37-4fb9-a8fa-d4f8a8cfd85a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:46.191331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c9457c11-0a37-4fb9-a8fa-d4f8a8cfd85a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1088 microversion: 2.1 time: 0.105117 Jun 21 10:07:46.202591 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 543/1027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:46 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1088 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:47.210018 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:47.211232 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:47.220797 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:47.221423 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:47.222872 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:47.223722 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:47.325066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:47.335011 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3d80bfe6-2e33-47fa-b950-88e56c4059e6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1186 microversion: 2.1 time: 0.129548 Jun 21 10:07:47.335580 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 485/1028] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:47 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1186 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:48.353061 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:48.353674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:48.382146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:48.382947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:48.383749 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:48.386324 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:48.584383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:48.598172 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-74168190-c4ac-4060-8ecd-c9b89d956d42 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1271 microversion: 2.1 time: 0.249357 Jun 21 10:07:48.609534 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 544/1029] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:48 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:49.126221 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-a7ec47d8-c170-4d71-888e-30967d02c897 req-2105dd9b-ff7f-4b56-b9f2-02e63efc25df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:07:49.140927 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a7ec47d8-c170-4d71-888e-30967d02c897 req-2105dd9b-ff7f-4b56-b9f2-02e63efc25df service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:49.143175 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a7ec47d8-c170-4d71-888e-30967d02c897 req-2105dd9b-ff7f-4b56-b9f2-02e63efc25df service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:49.163387 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-a7ec47d8-c170-4d71-888e-30967d02c897 req-2105dd9b-ff7f-4b56-b9f2-02e63efc25df service nova] Creating event network-changed:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:07:49.178188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-a7ec47d8-c170-4d71-888e-30967d02c897 req-2105dd9b-ff7f-4b56-b9f2-02e63efc25df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050889 Jun 21 10:07:49.179061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 486/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:07:49.615930 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:49.616679 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:49.623556 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:49.624343 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:49.625326 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:49.625955 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:49.784328 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:49.797282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0bd4ad93-fe9c-4c00-ab6a-3ee1fcf82903 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.184621 Jun 21 10:07:49.798561 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 545/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:49 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:50.816611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:50.817308 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:50.827447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:50.828088 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:50.829373 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:50.830211 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:50.987545 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:50.996023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-11af1311-6c2b-4ad9-9753-9c71bb5eab71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.184636 Jun 21 10:07:50.997176 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 487/1032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:50 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:52.011772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:52.012411 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:52.019406 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:52.020297 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:52.022025 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:52.022987 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:52.232226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:52.242542 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4d1c3a0e-ef6a-471d-a15c-c72388532ab8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.234460 Jun 21 10:07:52.251877 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 546/1033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:52 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:53.261674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:53.263910 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:53.272704 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:53.273402 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:53.274376 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:53.275003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:53.423598 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:53.431077 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3718716d-905a-454d-affb-74003b1b7fec tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.176238 Jun 21 10:07:53.431629 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 488/1034] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:53 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:54.448153 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:54.448777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:54.455077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:54.455529 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:54.456356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:54.456792 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:54.588432 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:54.596401 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f87e2d2a-f7b0-4af2-af42-8275f512326b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.152270 Jun 21 10:07:54.596953 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 547/1035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:54 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:55.613050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:55.613574 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:55.620273 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:55.620718 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:55.621470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:55.621901 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:55.751689 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:55.759072 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2ed55089-a2eb-4b2b-bc20-8637f06b17e4 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.150016 Jun 21 10:07:55.759618 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 489/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:55 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:56.775473 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:56.776119 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:56.778491 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:56.784373 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:56.785033 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:56.785816 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:56.786268 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:56.912302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:56.919648 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7097daf6-eb09-4563-abca-729e47dd17b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.148001 Jun 21 10:07:56.920225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 548/1037] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:56 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:57.936271 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:57.937492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:57.939362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:57.940050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:57.946443 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:57.946886 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:57.947642 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:57.948103 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:58.074991 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:58.082876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8d7582d8-ab04-45c8-a073-5a43b96d0b7d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.150580 Jun 21 10:07:58.083429 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 490/1038] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:57 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:07:59.099185 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:07:59.100548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:07:59.107083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:59.107538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:59.108938 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:07:59.109405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:07:59.240558 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:07:59.248408 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ee497b63-0011-41e0-87f6-248f9350d71a tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.153056 Jun 21 10:07:59.248997 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 549/1039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:07:59 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:00.025771 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1802693316", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1958769818", "security_groups": [{"name": "tempest-secgroup-smoke-1519349506"}], "block_device_mapping_v2": [{"uuid": "911fbe4e-5419-42c8-8990-90c24b36be75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb4c5df0-05d0-4ec2-aa30-ec9c2dbcfbdd"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:00.149107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] validate_networks() for [('eb4c5df0-05d0-4ec2-aa30-ec9c2dbcfbdd', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:08:00.265446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:00.266058 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:00.272691 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:00.273148 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:00.273920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:00.274538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:00.437250 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:00.455272 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a55e3f4c-6961-4be6-a6a6-0e7614c50289 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.193977 Jun 21 10:08:00.463275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 550/1040] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:00 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:00.819193 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:08:00.819622 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:08:00.820182 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:08:00.820547 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:08:00.820962 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:08:00.831616 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:00.832107 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:00.832920 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:00.833362 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:00.850055 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for project 95b4310d4b154732b31c773044f56154. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:08:00.854027 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Getting quotas for user b51e11f068d948a889871ce53ce29ceb and project 95b4310d4b154732b31c773044f56154. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:08:00.911879 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:08:00.914084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='911fbe4e-5419-42c8-8990-90c24b36be75',volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:08:01.067496 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d1709d5c-7bc3-4f56-8bb6-341b018af862 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.045545 Jun 21 10:08:01.069671 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 491/1041] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:08:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:08:01.079942 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-201d4cbd-d0e0-4d75-a576-c9be9fdb1b79 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:01.080662 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-201d4cbd-d0e0-4d75-a576-c9be9fdb1b79 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:01.156873 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-201d4cbd-d0e0-4d75-a576-c9be9fdb1b79 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:01.172301 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-201d4cbd-d0e0-4d75-a576-c9be9fdb1b79 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1095 microversion: 2.1 time: 0.096489 Jun 21 10:08:01.183036 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 551/1042] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:01 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:01.347140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-692e52d7-1f1b-4aab-bd9f-ae0f3614955e req-8b0e4262-489c-4217-b26a-aa7d5c94f884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "name": "network-vif-plugged", "status": "completed", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:01.355890 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-692e52d7-1f1b-4aab-bd9f-ae0f3614955e req-8b0e4262-489c-4217-b26a-aa7d5c94f884 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:01.356721 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-692e52d7-1f1b-4aab-bd9f-ae0f3614955e req-8b0e4262-489c-4217-b26a-aa7d5c94f884 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:01.372122 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-692e52d7-1f1b-4aab-bd9f-ae0f3614955e req-8b0e4262-489c-4217-b26a-aa7d5c94f884 service nova] Creating event network-vif-plugged:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:08:01.378223 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-692e52d7-1f1b-4aab-bd9f-ae0f3614955e req-8b0e4262-489c-4217-b26a-aa7d5c94f884 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Jun 21 10:08:01.379768 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 492/1043] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:01.474216 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:01.474907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:01.482088 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:01.482652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:01.484050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:01.484446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:01.651555 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:01.662554 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f3f37ee9-5cd1-423d-a75c-11c443a258f1 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.193582 Jun 21 10:08:01.663371 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 552/1044] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:01 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:02.191127 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:02.191815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:02.198014 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:02.198455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:02.199212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:02.199645 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:02.261118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:02.269340 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6ca32af4-b3ca-4c3f-becc-a9615bb684ec tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1193 microversion: 2.1 time: 0.083315 Jun 21 10:08:02.269948 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 493/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:02 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:02.679888 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:02.680455 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:02.687214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:02.687652 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:02.688460 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:02.688894 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:02.825761 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:02.833395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-562e59bc-6568-4811-91c0-179299e3f4ed tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1259 microversion: 2.1 time: 0.157454 Jun 21 10:08:02.833951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 553/1046] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:02 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:03.286979 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:03.287588 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:03.294321 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:03.294779 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:03.295587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:03.296086 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:03.358005 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:03.367452 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2a99c5ac-b573-4426-9a95-6ed39169fb59 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1201 microversion: 2.1 time: 0.084278 Jun 21 10:08:03.368043 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 494/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:03 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:03.849857 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:03.850469 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:03.857221 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:03.857674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:03.858657 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:03.859101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:03.996608 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:04.005642 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-72b249fc-0106-4758-947c-b04d46966749 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1443 microversion: 2.1 time: 0.159655 Jun 21 10:08:04.006244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 554/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:03 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:04.021638 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:04.022205 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:04.028446 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:04.028896 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:04.029697 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:04.030145 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:04.269867 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:04.297081 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-768a4274-1e27-4fef-8917-9c75766b5a71 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1443 microversion: 2.1 time: 0.279190 Jun 21 10:08:04.298710 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 495/1049] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:04 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1443 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:04.384911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:04.386075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:04.392403 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:04.392984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:04.393754 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:04.394187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:04.569862 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:04.577392 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-86d23ce4-d40e-4eca-8285-6dcc488ce0c1 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.196908 Jun 21 10:08:04.579728 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 555/1050] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:04 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:04.975470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0d6cc336-d1aa-43eb-99b9-3645bfe26a5b req-7ce60d6b-2d6d-4ad6-8792-44c47fb82391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0957a5a-0e2b-45ef-915a-18c6b7a1668d", "tag": "2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:04.995865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d6cc336-d1aa-43eb-99b9-3645bfe26a5b req-7ce60d6b-2d6d-4ad6-8792-44c47fb82391 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:04.996624 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0d6cc336-d1aa-43eb-99b9-3645bfe26a5b req-7ce60d6b-2d6d-4ad6-8792-44c47fb82391 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:05.010332 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0d6cc336-d1aa-43eb-99b9-3645bfe26a5b req-7ce60d6b-2d6d-4ad6-8792-44c47fb82391 service nova] Creating event network-changed:2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8 for instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d on hv-cinder-80660 Jun 21 10:08:05.016965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0d6cc336-d1aa-43eb-99b9-3645bfe26a5b req-7ce60d6b-2d6d-4ad6-8792-44c47fb82391 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046652 Jun 21 10:08:05.017593 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 496/1051] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:05.594541 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:05.595787 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:05.602966 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:05.603453 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:05.604263 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:05.604700 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:05.830748 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:05.838745 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b0a02c43-7227-41ca-97fa-29d8cf00f830 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.247940 Jun 21 10:08:05.840000 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 556/1052] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:05 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:06.311076 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-93e6db0d-28f0-4ec4-b9d1-e4e1fb582fba req-a2c35d93-d8f9-4783-9b9f-ea170ae0d2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:06.319965 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-93e6db0d-28f0-4ec4-b9d1-e4e1fb582fba req-a2c35d93-d8f9-4783-9b9f-ea170ae0d2e2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:06.320431 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-93e6db0d-28f0-4ec4-b9d1-e4e1fb582fba req-a2c35d93-d8f9-4783-9b9f-ea170ae0d2e2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:06.333026 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-93e6db0d-28f0-4ec4-b9d1-e4e1fb582fba req-a2c35d93-d8f9-4783-9b9f-ea170ae0d2e2 service nova] Creating event network-changed:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:08:06.337849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-93e6db0d-28f0-4ec4-b9d1-e4e1fb582fba req-a2c35d93-d8f9-4783-9b9f-ea170ae0d2e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037423 Jun 21 10:08:06.338447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 497/1053] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:08:06.857524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:06.858743 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:06.866169 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:06.866859 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:06.867855 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:06.868812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:07.016246 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:07.023829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-74076a43-55b5-4f18-b0d9-131a73edb18e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.170774 Jun 21 10:08:07.024401 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 557/1054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:06 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:08.041703 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:08.042458 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:08.049251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:08.049697 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:08.050453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:08.050888 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:08.185909 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:08.193366 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1960d169-aa41-4b39-b5f5-0065d1d15f35 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.156654 Jun 21 10:08:08.193913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 498/1055] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:08 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:09.210290 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:09.210989 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:09.218050 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:09.218485 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:09.219269 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:09.219707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:09.351592 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:09.359416 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-faf6e0c4-658d-4c54-8d37-6c822171b6c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.153034 Jun 21 10:08:09.359960 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 558/1056] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:09 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:10.376520 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:10.377044 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:10.383495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:10.383944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:10.384729 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:10.385161 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:10.512984 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:10.521155 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-760713f9-6dd7-4480-b97f-2b91091f06fd tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.149112 Jun 21 10:08:10.521709 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 499/1057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:10 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:11.537677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:11.538276 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:11.540560 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:11.546274 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:11.546729 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:11.547502 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:11.548110 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:11.682808 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:11.691354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3d8598c8-eaa5-4138-b991-c4fb9c90c3ed tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.157329 Jun 21 10:08:11.691929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 559/1058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:11 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:12.707646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:12.708209 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:12.710157 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:12.710816 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:12.717571 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:12.718512 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:12.719272 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:12.719711 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:12.849398 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:12.856876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-81a6b931-243f-4380-8caa-f17e9b853781 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.153182 Jun 21 10:08:12.857453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 500/1059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:12 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:13.874176 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:13.874793 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:13.881929 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:13.882386 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:13.883154 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:13.883595 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:14.016490 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:14.023905 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3e94067b-cd34-46ad-9faa-6163f409e989 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.153539 Jun 21 10:08:14.024531 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 560/1060] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:13 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:15.040546 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:15.041151 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:15.047599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:15.048138 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:15.048895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:15.049326 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:15.185587 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:15.193903 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-02ff113a-1bf0-42a8-9648-7e1442a5dcd9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.157175 Jun 21 10:08:15.194550 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 501/1061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:15 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:16.211231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:16.211866 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:16.214214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=41 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:16.219454 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:16.219900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:16.220687 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:16.221122 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:16.224197 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:16.349501 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:16.357029 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c0a79754-6512-49de-a0d5-ec50f272a9bf tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.149619 Jun 21 10:08:16.357519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 561/1062] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:16 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:17.247680 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-ccc90353-1b7c-4a74-b7f2-54a4fb0ffb0b req-60612e83-52a1-4ae3-b8de-082f863a5ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0957a5a-0e2b-45ef-915a-18c6b7a1668d", "name": "network-vif-plugged", "status": "completed", "tag": "2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:17.251633 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:17.258142 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ccc90353-1b7c-4a74-b7f2-54a4fb0ffb0b req-60612e83-52a1-4ae3-b8de-082f863a5ca3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:17.258593 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ccc90353-1b7c-4a74-b7f2-54a4fb0ffb0b req-60612e83-52a1-4ae3-b8de-082f863a5ca3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:17.262997 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=85 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:17.272024 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-ccc90353-1b7c-4a74-b7f2-54a4fb0ffb0b req-60612e83-52a1-4ae3-b8de-082f863a5ca3 service nova] Creating event network-vif-plugged:2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8 for instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d on hv-cinder-80660 Jun 21 10:08:17.277140 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-ccc90353-1b7c-4a74-b7f2-54a4fb0ffb0b req-60612e83-52a1-4ae3-b8de-082f863a5ca3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Jun 21 10:08:17.277990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 502/1063] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:17.374231 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:17.374848 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:17.381981 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:17.382435 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:17.383204 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:17.383643 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:17.521300 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:17.528956 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cc38d994-3a15-47ed-b4e4-87e875d7dedc tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.158653 Jun 21 10:08:17.534528 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 562/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:17 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:18.546483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:18.547204 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:18.554044 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:18.554492 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:18.555251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:18.555685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:18.688610 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:18.696052 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0bf6fc03-4680-4b9b-b5e2-b3e2cecdf2c6 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.154279 Jun 21 10:08:18.696604 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 503/1065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:18 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:19.712952 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:19.713556 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:19.720028 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:19.720483 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:19.721244 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:19.721680 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:19.849499 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:19.857101 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b8161605-1ac5-4180-a837-fc9b5118f0c7 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.148074 Jun 21 10:08:19.857782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 563/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:19 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:20.881279 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:20.881967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:20.888477 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:20.888924 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:20.889676 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:20.890108 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:21.018529 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:21.025906 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e80e5eb7-eba3-4606-b8ee-4d3fbd8a29ab tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1267 microversion: 2.1 time: 0.148507 Jun 21 10:08:21.026453 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 504/1067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:20 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:22.042998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:22.043635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:22.050951 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:22.051405 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:22.052200 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:22.052639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:22.181287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:22.188831 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-92c8d3c9-a5fd-4b94-a960-200cf81664f9 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1453 microversion: 2.1 time: 0.149711 Jun 21 10:08:22.189387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 564/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:22 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:22.204693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:22.205305 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:22.211737 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:22.212218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:22.212975 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:22.213406 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:22.340658 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:22.348940 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ff03897f-22fa-4a9a-8d11-53dca073a020 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1453 microversion: 2.1 time: 0.148055 Jun 21 10:08:22.349488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 505/1069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:22 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:24.160539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-c675e54e-1205-48d6-8a3c-4dc3e024e5c4 req-2e9a6769-94a5-4c6b-8e64-ae255064493b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0957a5a-0e2b-45ef-915a-18c6b7a1668d", "tag": "2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:24.169218 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c675e54e-1205-48d6-8a3c-4dc3e024e5c4 req-2e9a6769-94a5-4c6b-8e64-ae255064493b service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:24.169667 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c675e54e-1205-48d6-8a3c-4dc3e024e5c4 req-2e9a6769-94a5-4c6b-8e64-ae255064493b service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:24.182785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-c675e54e-1205-48d6-8a3c-4dc3e024e5c4 req-2e9a6769-94a5-4c6b-8e64-ae255064493b service nova] Creating event network-changed:2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8 for instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d on hv-cinder-80660 Jun 21 10:08:24.187871 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-c675e54e-1205-48d6-8a3c-4dc3e024e5c4 req-2e9a6769-94a5-4c6b-8e64-ae255064493b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Jun 21 10:08:24.188494 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 565/1070] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:37.818849 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-954670938", "imageRef": "dae09dc4-6093-42a6-aa70-da1b3ba4301e", "flavorRef": "452"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:37.824715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=7 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:37.825363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=19 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:37.869741 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] validate_networks() for None {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:08:38.139100 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:08:38.139529 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:08:38.140040 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:08:38.140460 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:08:38.140880 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:08:38.151144 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:38.151595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:38.152525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:38.152966 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:38.169428 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Getting quotas for project 4fcb310999794e8ba3142f4eff71ca99. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:08:38.173268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Getting quotas for user 79f82093f8cd46e59d5e8921738ad955 and project 4fcb310999794e8ba3142f4eff71ca99. Resources: {'cores', 'instances', 'ram'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:08:38.184065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:08:38.186274 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dae09dc4-6093-42a6-aa70-da1b3ba4301e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:08:38.229808 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-918fa81f-531d-47ef-9897-0a9d8a2b12e8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.414711 Jun 21 10:08:38.230449 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 506/1071] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 21 10:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:08:38.238282 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=9 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:38.239013 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=25 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:38.244188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-97fb5cef-cd59-417a-a3aa-2a3214605013 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:38.244967 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-97fb5cef-cd59-417a-a3aa-2a3214605013 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:38.305161 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-97fb5cef-cd59-417a-a3aa-2a3214605013 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:38.313514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-97fb5cef-cd59-417a-a3aa-2a3214605013 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1214 microversion: 2.1 time: 0.076711 Jun 21 10:08:38.314063 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 566/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:38 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:39.330694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:39.331305 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:39.338094 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:39.338478 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:39.339255 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:39.339698 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:39.413275 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:39.420787 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b62e7fed-3afe-4b3e-987b-1d6773354df8 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1284 microversion: 2.1 time: 0.094507 Jun 21 10:08:39.421335 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 507/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:39 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:40.437627 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:40.438183 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:40.445087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:40.445611 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:40.446440 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:40.446883 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:40.580967 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:40.589331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-50ddfb5f-e591-49a1-aa6a-b7010d50a524 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.155605 Jun 21 10:08:40.589900 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 567/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:40 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:40.842000 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-ed6e6116-aea0-4655-95d3-b443b71d81e7 req-655addd7-5e5c-4185-b9a1-1f0c05ea261c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc80d745-d554-4b0b-adcc-83db4849ceef", "tag": "743405e0-a35c-4fe6-bc8d-e34757a09579"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:40.862369 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ed6e6116-aea0-4655-95d3-b443b71d81e7 req-655addd7-5e5c-4185-b9a1-1f0c05ea261c service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:40.862819 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ed6e6116-aea0-4655-95d3-b443b71d81e7 req-655addd7-5e5c-4185-b9a1-1f0c05ea261c service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:40.877773 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-ed6e6116-aea0-4655-95d3-b443b71d81e7 req-655addd7-5e5c-4185-b9a1-1f0c05ea261c service nova] Creating event network-changed:743405e0-a35c-4fe6-bc8d-e34757a09579 for instance dc80d745-d554-4b0b-adcc-83db4849ceef on hv-cinder-80660 Jun 21 10:08:40.885200 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-ed6e6116-aea0-4655-95d3-b443b71d81e7 req-655addd7-5e5c-4185-b9a1-1f0c05ea261c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049917 Jun 21 10:08:40.886317 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 508/1075] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:41.606707 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:41.607320 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:41.614358 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:41.614806 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:41.615570 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:41.616031 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:41.740201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:41.747757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b5d7a8c4-2a0a-4442-b507-e5cdb23d59da tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.144899 Jun 21 10:08:41.748344 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 568/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:41 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:42.764890 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:42.765626 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:42.773004 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:42.773455 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:42.774218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:42.774654 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:42.904352 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:42.911681 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-751b04a6-894e-4daf-8264-7ae8b6996f14 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.150991 Jun 21 10:08:42.912283 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 509/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:42 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:43.928709 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:43.929351 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:43.935815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:43.936312 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:43.937080 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:43.937519 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:44.065273 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:44.072606 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-659ccd8c-567e-40ee-a7ea-62c857df701c tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.148378 Jun 21 10:08:44.073164 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 569/1078] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:43 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:45.089095 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:45.090168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:45.096815 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:45.097268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:45.098035 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:45.098514 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:45.224403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:45.231810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-11cc8271-9753-43ce-9f5c-35bd47404b70 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.146604 Jun 21 10:08:45.232410 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 510/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:45 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:46.249245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:46.249852 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:46.256719 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:46.257167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:46.257933 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:46.258372 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:46.385481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:46.392881 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4e4401a6-f5e8-45c4-9bff-cf87976eac44 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.147535 Jun 21 10:08:46.393641 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 570/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:46 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:47.410132 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:47.412134 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:47.415908 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-22e28e4a-e78f-4193-9cc4-5e4d109da583 req-809475f8-ffb5-4613-8b9e-1cd40c538ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc80d745-d554-4b0b-adcc-83db4849ceef", "name": "network-vif-plugged", "status": "completed", "tag": "743405e0-a35c-4fe6-bc8d-e34757a09579"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:47.419506 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:47.420288 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:47.421294 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:47.422119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:47.428698 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-22e28e4a-e78f-4193-9cc4-5e4d109da583 req-809475f8-ffb5-4613-8b9e-1cd40c538ee3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:47.429188 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-22e28e4a-e78f-4193-9cc4-5e4d109da583 req-809475f8-ffb5-4613-8b9e-1cd40c538ee3 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:47.441947 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-22e28e4a-e78f-4193-9cc4-5e4d109da583 req-809475f8-ffb5-4613-8b9e-1cd40c538ee3 service nova] Creating event network-vif-plugged:743405e0-a35c-4fe6-bc8d-e34757a09579 for instance dc80d745-d554-4b0b-adcc-83db4849ceef on hv-cinder-80660 Jun 21 10:08:47.447106 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-22e28e4a-e78f-4193-9cc4-5e4d109da583 req-809475f8-ffb5-4613-8b9e-1cd40c538ee3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037212 Jun 21 10:08:47.447928 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 571/1081] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:47.570652 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:47.578759 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-998b2ded-1c99-4966-9537-ccf099899439 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.172748 Jun 21 10:08:47.579338 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 511/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:47 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:48.594333 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:48.599036 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:48.600271 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:48.606702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:48.607157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:48.607926 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:48.608395 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:48.741914 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:48.749625 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-87f6e9b1-9301-433b-a8f0-d7ba144cb7e2 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1314 microversion: 2.1 time: 0.156256 Jun 21 10:08:48.750196 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 572/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:48 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:49.765158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:49.765772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:49.767723 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:49.768578 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:49.774892 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:49.775344 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:49.776137 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:49.776576 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:50.057526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:50.064951 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-137e9d18-d2f8-461d-b6c3-f06676c48b8a tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1464 microversion: 2.1 time: 0.303687 Jun 21 10:08:50.065511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 512/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:49 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:50.103934 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:50.104456 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:50.110911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:50.111354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:50.112146 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:50.112580 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:50.139067 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:08:50.210807 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fa95abe0-9268-4291-bcc1-b746d7847b2b tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 204 len: 0 microversion: 2.1 time: 0.110457 Jun 21 10:08:50.211566 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 573/1085] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:08:50 2022] DELETE /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:08:50.219613 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:50.220356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:50.226414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:50.226865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:50.227620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:50.228079 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:50.357400 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:50.365234 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d1cb4e42-1433-447d-8c5d-3d88ba437c91 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1470 microversion: 2.1 time: 0.149186 Jun 21 10:08:50.365820 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 513/1086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:50 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:51.383702 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:51.384384 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:51.390836 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:51.391289 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:51.392080 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:51.392521 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:51.529354 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:51.536950 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b83c39bf-2c36-4cc5-ac45-6fb47bd6aad7 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1470 microversion: 2.1 time: 0.158072 Jun 21 10:08:51.537505 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 574/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:51 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:52.554059 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:52.554685 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:52.561410 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:52.561868 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:52.562647 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:52.563094 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:52.650786 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f82093f8cd46e59d5e8921738ad955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fcb310999794e8ba3142f4eff71ca99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:08:52.658752 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-795f7cb4-59c9-435d-a0cc-1f27daea0c89 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 200 len: 1428 microversion: 2.1 time: 0.108509 Jun 21 10:08:52.659598 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 514/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:52 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 1428 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:08:52.690535 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-5b6e4ef8-9003-48f4-8536-d6ee72cf9d44 req-32fb2696-1b26-47c8-989d-2e4f29b03917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc80d745-d554-4b0b-adcc-83db4849ceef", "name": "network-vif-deleted", "tag": "743405e0-a35c-4fe6-bc8d-e34757a09579"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:08:52.699473 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-5b6e4ef8-9003-48f4-8536-d6ee72cf9d44 req-32fb2696-1b26-47c8-989d-2e4f29b03917 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:52.699917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-5b6e4ef8-9003-48f4-8536-d6ee72cf9d44 req-32fb2696-1b26-47c8-989d-2e4f29b03917 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:52.713214 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-5b6e4ef8-9003-48f4-8536-d6ee72cf9d44 req-32fb2696-1b26-47c8-989d-2e4f29b03917 service nova] Creating event network-vif-deleted:743405e0-a35c-4fe6-bc8d-e34757a09579 for instance dc80d745-d554-4b0b-adcc-83db4849ceef on hv-cinder-80660 Jun 21 10:08:52.718644 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-5b6e4ef8-9003-48f4-8536-d6ee72cf9d44 req-32fb2696-1b26-47c8-989d-2e4f29b03917 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Jun 21 10:08:52.720347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 575/1089] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:08:53.676183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:08:53.676789 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] [instance: dc80d745-d554-4b0b-adcc-83db4849ceef] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:08:53.684105 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:53.684552 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:53.685488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:08:53.685921 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:08:53.698957 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] HTTP exception thrown: Instance dc80d745-d554-4b0b-adcc-83db4849ceef could not be found. Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Request method failure captured: Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef HTTP/1.1 Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZikwcuqsnP-O-ri-DnPIpn4_q1R1J9hMpXOVbw-wpWjSi_QODspEQVqIBGE3qWrHe6eaSRqOoRl4b5i-2qQy7McYQOCaI_wQxp9kk6fe75Y8-xgeVtT_p039rFZMcahzBO1znwa4Pca-Cox45hPIUq5RXVTEO-hMsMAxIlNw2r5KXg Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 4fcb310999794e8ba3142f4eff71ca99 Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1294630308 Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:08:53.700772 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4fcb310999794e8ba3142f4eff71ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fcb310999794e8ba3142f4eff71ca99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fcb310999794e8ba3142f4eff71ca99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4fcb310999794e8ba3142f4eff71ca99"}]}] Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1294630308 Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 4fcb310999794e8ba3142f4eff71ca99 Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1294630308 Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1294630308-project Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: 79f82093f8cd46e59d5e8921738ad955 Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1294630308-project Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance dc80d745-d554-4b0b-adcc-83db4849ceef could not be found. Jun 21 10:08:53.702313 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'dc80d745-d554-4b0b-adcc-83db4849ceef'} Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc80d745-d554-4b0b-adcc-83db4849ceef could not be found. Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:08:53.703164 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc80d745-d554-4b0b-adcc-83db4849ceef could not be found. Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc80d745-d554-4b0b-adcc-83db4849ceef could not be found. Jun 21 10:08:53.704611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:08:53.705882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] Returning 404 to user: Instance dc80d745-d554-4b0b-adcc-83db4849ceef could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:08:53.705882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b6b51701-3cd8-4f6d-9b96-ec88d2148aa5 tempest-VolumesNegativeTest-1294630308 tempest-VolumesNegativeTest-1294630308-project] 10.222.0.36 "GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef" status: 404 len: 111 microversion: 2.1 time: 0.029799 Jun 21 10:08:53.705882 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 515/1090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:08:53 2022] GET /compute/v2.1/servers/dc80d745-d554-4b0b-adcc-83db4849ceef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:09:01.159782 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:09:01.160293 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Tue Jun 21 10:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:09:02.471072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:09:02.471606 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Tue Jun 21 10:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:10:05.457530 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:05.458370 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=48 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:05.459383 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:05.459987 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:05.464012 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:05.464798 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:05.470055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:05.470753 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:05.471759 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:05.472314 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:05.500226 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:10:05.584087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-24e0b381-eb63-4cc1-b9b6-841000dcd066 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 204 len: 0 microversion: 2.1 time: 0.129998 Jun 21 10:10:05.587931 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 576/1091] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:10:05 2022] DELETE /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:10:05.595075 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:05.595776 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:05.605007 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:05.605536 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:05.606392 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:05.606899 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-45fef2ab-5500-4096-9f3e-d488b2d613b1 req-debe7d9d-4771-44cf-aef8-f353917bc5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0957a5a-0e2b-45ef-915a-18c6b7a1668d", "tag": "2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:05.607129 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:05.616156 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-45fef2ab-5500-4096-9f3e-d488b2d613b1 req-debe7d9d-4771-44cf-aef8-f353917bc5c2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:05.616602 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-45fef2ab-5500-4096-9f3e-d488b2d613b1 req-debe7d9d-4771-44cf-aef8-f353917bc5c2 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:05.628566 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-45fef2ab-5500-4096-9f3e-d488b2d613b1 req-debe7d9d-4771-44cf-aef8-f353917bc5c2 service nova] Creating event network-changed:2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8 for instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d on hv-cinder-80660 Jun 21 10:10:05.634619 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-45fef2ab-5500-4096-9f3e-d488b2d613b1 req-debe7d9d-4771-44cf-aef8-f353917bc5c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178085 Jun 21 10:10:05.635484 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 516/1092] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:10:05.797010 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:05.804594 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-35f5cc5c-7a88-44ac-a294-b95c9f71ee09 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1577 microversion: 2.1 time: 0.214940 Jun 21 10:10:05.805149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 577/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:05 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:10:06.823865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:06.824605 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:06.830944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:06.831404 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:06.832212 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:06.832658 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:06.961084 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:06.969485 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b81af164-6a72-4c7e-8b31-0d1113554384 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1577 microversion: 2.1 time: 0.150661 Jun 21 10:10:06.970044 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 517/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:06 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:07.986674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:07.987283 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:07.994277 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:07.994718 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:07.995476 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:07.995911 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:08.208704 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:08.216639 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-44a94d5b-0bdc-4a56-9191-a9caccdff1f4 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1459 microversion: 2.1 time: 0.233883 Jun 21 10:10:08.217190 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 578/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:07 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:08.378118 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-af7b62ab-3890-46a3-bafd-a8b97eadbd91 req-9d788376-ec5a-43d7-996b-92e4644ad7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0957a5a-0e2b-45ef-915a-18c6b7a1668d", "name": "network-vif-deleted", "tag": "2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:08.387934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-af7b62ab-3890-46a3-bafd-a8b97eadbd91 req-9d788376-ec5a-43d7-996b-92e4644ad7f8 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:08.388414 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-af7b62ab-3890-46a3-bafd-a8b97eadbd91 req-9d788376-ec5a-43d7-996b-92e4644ad7f8 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:08.399839 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-af7b62ab-3890-46a3-bafd-a8b97eadbd91 req-9d788376-ec5a-43d7-996b-92e4644ad7f8 service nova] Creating event network-vif-deleted:2cf09cba-d4c0-48f0-a9b0-15a3d5340bc8 for instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d on hv-cinder-80660 Jun 21 10:10:08.405184 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-af7b62ab-3890-46a3-bafd-a8b97eadbd91 req-9d788376-ec5a-43d7-996b-92e4644ad7f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030784 Jun 21 10:10:08.405764 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 518/1096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:10:09.234083 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:09.234698 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:09.241261 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:09.241711 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:09.242481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:09.242917 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:09.278531 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:09.278987 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:09.279774 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lazy-loading 'fault' on Instance uuid c0957a5a-0e2b-45ef-915a-18c6b7a1668d {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:10:09.326198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:09.333080 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a52e7932-172f-4555-99c7-2bfef1d078fb tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 200 len: 1185 microversion: 2.1 time: 0.102896 Jun 21 10:10:09.333665 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 579/1097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:09 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 1185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:10.351442 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:10.352169 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: c0957a5a-0e2b-45ef-915a-18c6b7a1668d] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:10.358913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:10.359363 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:10.360157 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:10.360595 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:10.374439 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] HTTP exception thrown: Instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d could not be found. Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Request method failure captured: Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d HTTP/1.1 Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZcqPQgtEB6yMnn4oGcnSDFApd7y9B0nw11rlkvYOdTjGkuTJMW2BJeQ_Y-F2S7O7aTVxsWUff5qmm8tPBZHR5kWp324gMkwBDjO5Z4oopo0dUr6S2KfID_KrpNP77oP1E6Y_22xRgB-UbLtSF4RK3n8THUj8_3IrZwPwQ1_lygJHRU Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:10:10.376147 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95b4310d4b154732b31c773044f56154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95b4310d4b154732b31c773044f56154"}]}] Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: b51e11f068d948a889871ce53ce29ceb Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d could not be found. Jun 21 10:10:10.377865 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'c0957a5a-0e2b-45ef-915a-18c6b7a1668d'} Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d could not be found. Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:10:10.378967 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d could not be found. Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d could not be found. Jun 21 10:10:10.380674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:10.382258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Returning 404 to user: Instance c0957a5a-0e2b-45ef-915a-18c6b7a1668d could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:10:10.382258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-72921e59-15ad-408c-8e1e-4ceeaf63d96c tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d" status: 404 len: 111 microversion: 2.1 time: 0.030832 Jun 21 10:10:10.382258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 519/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:10 2022] GET /compute/v2.1/servers/c0957a5a-0e2b-45ef-915a-18c6b7a1668d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:10:11.204090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:11.204621 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:11.211072 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:11.211520 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:11.212336 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:11.212772 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:11.235225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lazy-loading 'flavor' on Instance uuid c0599c50-5a77-48d9-9d67-86684593c05c {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:10:11.339814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-96c3fa2e-011d-4455-b539-ab7796fa844f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "POST /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c/action" status: 202 len: 0 microversion: 2.1 time: 0.139477 Jun 21 10:10:11.340430 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 580/1099] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:10:11 2022] POST /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:10:11.348694 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:11.349447 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:11.357374 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:11.358161 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:11.358602 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:11.359046 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:11.500002 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:11.508104 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-51f8d259-44cb-403b-aeb6-9067287cc38b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.163316 Jun 21 10:10:11.509299 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 520/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:11 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:12.525618 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:12.526303 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:12.532937 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:12.533380 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:12.534132 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:12.534564 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:12.673507 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:12.681712 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9b62c97e-ba2e-4071-b2eb-f6b2329ebd63 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.160319 Jun 21 10:10:12.682261 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 581/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:12 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:13.442016 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:13.442517 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:13.449840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.450335 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.451102 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.451548 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.478153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:10:13.509742 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-6bc7e60b-0689-4b50-b6bc-0bb4c850ac3e req-804854dc-4b4c-459e-9bc3-be00193f587f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e618752-2a25-40b4-8c2f-5630d4f18ba4", "tag": "04d5b713-1489-4c7c-a451-3dca2b8d1a52"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:13.519172 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-6bc7e60b-0689-4b50-b6bc-0bb4c850ac3e req-804854dc-4b4c-459e-9bc3-be00193f587f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.519659 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-6bc7e60b-0689-4b50-b6bc-0bb4c850ac3e req-804854dc-4b4c-459e-9bc3-be00193f587f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.533136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-6bc7e60b-0689-4b50-b6bc-0bb4c850ac3e req-804854dc-4b4c-459e-9bc3-be00193f587f service nova] Creating event network-changed:04d5b713-1489-4c7c-a451-3dca2b8d1a52 for instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 on hv-cinder-80660 Jun 21 10:10:13.538600 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-6bc7e60b-0689-4b50-b6bc-0bb4c850ac3e req-804854dc-4b4c-459e-9bc3-be00193f587f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091041 Jun 21 10:10:13.539202 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 582/1102] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:10:13.572483 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-db9fd764-1d80-43f0-b6c0-4b779d1eae18 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 204 len: 0 microversion: 2.1 time: 0.134231 Jun 21 10:10:13.574064 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 521/1103] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:10:13 2022] DELETE /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:10:13.583149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:13.584364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:13.592150 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.592958 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.593922 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.594360 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.699782 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:13.700510 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:13.706687 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.707141 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.707913 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:13.708374 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:13.732468 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:13.741077 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-73a9a749-f672-493e-9f57-35f314db775d tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1576 microversion: 2.1 time: 0.162261 Jun 21 10:10:13.751545 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 583/1104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:13 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:13.856688 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:13.864970 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fc542256-5696-42d3-bebd-44c4398d5fe5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.170030 Jun 21 10:10:13.865526 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 522/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:13 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:10:14.759578 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:14.760233 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:14.766732 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:14.767118 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:14.767869 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:14.768337 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:14.882699 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:14.883356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:14.890531 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:14.890990 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:14.891757 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:14.892222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:14.971213 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:14.980290 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-42cf239a-a687-49cf-afc9-026803516ff2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1576 microversion: 2.1 time: 0.225149 Jun 21 10:10:14.980864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 584/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:14 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:15.025087 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:15.032567 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-77483804-b187-43b1-9ff7-f455a6788b73 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.153785 Jun 21 10:10:15.033183 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 523/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:14 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:15.889820 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-587a68a5-63c5-4e83-888d-6cd5d5d8ae57 req-ae913361-73fa-4eac-822e-a4ffbc8ddf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e618752-2a25-40b4-8c2f-5630d4f18ba4", "name": "network-vif-deleted", "tag": "04d5b713-1489-4c7c-a451-3dca2b8d1a52"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:15.899038 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-587a68a5-63c5-4e83-888d-6cd5d5d8ae57 req-ae913361-73fa-4eac-822e-a4ffbc8ddf52 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:15.899481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-587a68a5-63c5-4e83-888d-6cd5d5d8ae57 req-ae913361-73fa-4eac-822e-a4ffbc8ddf52 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:15.914174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-587a68a5-63c5-4e83-888d-6cd5d5d8ae57 req-ae913361-73fa-4eac-822e-a4ffbc8ddf52 service nova] Creating event network-vif-deleted:04d5b713-1489-4c7c-a451-3dca2b8d1a52 for instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 on hv-cinder-80660 Jun 21 10:10:15.919318 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-587a68a5-63c5-4e83-888d-6cd5d5d8ae57 req-ae913361-73fa-4eac-822e-a4ffbc8ddf52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033234 Jun 21 10:10:15.919998 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 585/1108] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:10:15.998433 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:15.998803 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:16.005136 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:16.005543 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:16.006314 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:16.006748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:16.050593 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:16.051307 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:16.058098 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:16.058544 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:16.059300 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:16.059736 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:16.069422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51e11f068d948a889871ce53ce29ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b4310d4b154732b31c773044f56154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:16.077589 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3874ca7c-4183-4690-8c2f-da9e93f0cba0 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 200 len: 1225 microversion: 2.1 time: 0.083541 Jun 21 10:10:16.078159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 524/1109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:15 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:16.190585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:16.198812 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9edff32a-051e-4f13-a4f7-811fbc5dadfc tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.152433 Jun 21 10:10:16.199374 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 586/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:16 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:10:17.095181 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:17.095735 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: 1e618752-2a25-40b4-8c2f-5630d4f18ba4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:17.102854 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.103306 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.104099 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.104541 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.118611 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] HTTP exception thrown: Instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 could not be found. Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Request method failure captured: Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 HTTP/1.1 Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZcqPQgtEB6yMnn4oGcnSDFApd7y9B0nw11rlkvYOdTjGkuTJMW2BJeQ_Y-F2S7O7aTVxsWUff5qmm8tPBZHR5kWp324gMkwBDjO5Z4oopo0dUr6S2KfID_KrpNP77oP1E6Y_22xRgB-UbLtSF4RK3n8THUj8_3IrZwPwQ1_lygJHRU Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:10:17.120356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95b4310d4b154732b31c773044f56154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95b4310d4b154732b31c773044f56154"}]}] Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: b51e11f068d948a889871ce53ce29ceb Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 could not be found. Jun 21 10:10:17.122006 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': '1e618752-2a25-40b4-8c2f-5630d4f18ba4'} Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 could not be found. Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:10:17.123268 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 could not be found. Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 could not be found. Jun 21 10:10:17.124934 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.126748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Returning 404 to user: Instance 1e618752-2a25-40b4-8c2f-5630d4f18ba4 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:10:17.126748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b3d31808-0b87-455f-934f-eec8dbd3e81e tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4" status: 404 len: 111 microversion: 2.1 time: 0.030608 Jun 21 10:10:17.126748 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 525/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:17 2022] GET /compute/v2.1/servers/1e618752-2a25-40b4-8c2f-5630d4f18ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:10:17.216136 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:17.216710 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:17.223225 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.223677 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.224475 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.224920 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.440939 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:17.448612 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-23203219-2153-48bb-a1b6-f713c72aa039 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.236525 Jun 21 10:10:17.449275 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 587/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:17 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:17.625763 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:17.626260 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:17.632218 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.632688 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.633443 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.633876 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.646944 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] HTTP exception thrown: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Request method failure captured: Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab HTTP/1.1 Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Connection: close Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Host: 10.222.0.36 Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABisZcqPQgtEB6yMnn4oGcnSDFApd7y9B0nw11rlkvYOdTjGkuTJMW2BJeQ_Y-F2S7O7aTVxsWUff5qmm8tPBZHR5kWp324gMkwBDjO5Z4oopo0dUr6S2KfID_KrpNP77oP1E6Y_22xRgB-UbLtSF4RK3n8THUj8_3IrZwPwQ1_lygJHRU Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Role: reader,member Jun 21 10:10:17.648615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Roles: reader,member Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95b4310d4b154732b31c773044f56154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95b4310d4b154732b31c773044f56154"}]}] Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Id: b51e11f068d948a889871ce53ce29ceb Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: method: > Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: exception: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.650845 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e5a76d1a-f9e8-459f-92ad-02a806ab20ab'} Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:10:17.651754 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.653353 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.655168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Returning 404 to user: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:10:17.655168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-be14671b-20f3-43c4-a965-37b27327b625 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 404 len: 111 microversion: 2.1 time: 0.028637 Jun 21 10:10:17.655168 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 526/1113] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:10:17 2022] DELETE /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:10:17.658802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:17.659451 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] [instance: e5a76d1a-f9e8-459f-92ad-02a806ab20ab] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:17.666066 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.666553 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.667324 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:17.667765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:17.680962 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] HTTP exception thrown: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Request method failure captured: Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab HTTP/1.1 Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZcqPQgtEB6yMnn4oGcnSDFApd7y9B0nw11rlkvYOdTjGkuTJMW2BJeQ_Y-F2S7O7aTVxsWUff5qmm8tPBZHR5kWp324gMkwBDjO5Z4oopo0dUr6S2KfID_KrpNP77oP1E6Y_22xRgB-UbLtSF4RK3n8THUj8_3IrZwPwQ1_lygJHRU Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:10:17.682635 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95b4310d4b154732b31c773044f56154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95b4310d4b154732b31c773044f56154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95b4310d4b154732b31c773044f56154"}]}] Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 95b4310d4b154732b31c773044f56154 Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestVolumeBootPattern-339556319 Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: b51e11f068d948a889871ce53ce29ceb Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestVolumeBootPattern-339556319-project Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.684331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'e5a76d1a-f9e8-459f-92ad-02a806ab20ab'} Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:10:17.687907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. Jun 21 10:10:17.689540 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:10:17.690984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Returning 404 to user: Instance e5a76d1a-f9e8-459f-92ad-02a806ab20ab could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:10:17.690984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c53a72ac-dba5-4a46-bbf0-69df58412aa2 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab" status: 404 len: 111 microversion: 2.1 time: 0.029000 Jun 21 10:10:17.690984 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 588/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:17 2022] GET /compute/v2.1/servers/e5a76d1a-f9e8-459f-92ad-02a806ab20ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:10:18.465715 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:18.466251 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:18.472759 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:18.473205 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:18.473957 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:18.474389 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:18.604001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:18.611459 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f7364918-0434-4e71-af80-982359852b70 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.149707 Jun 21 10:10:18.612023 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 527/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:18 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:18.970446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0ad41741-68ef-44f0-9421-8b9664370886 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] Calling method '.version_select at 0x7f184ae3c8b0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:18.992865 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0ad41741-68ef-44f0-9421-8b9664370886 tempest-TestVolumeBootPattern-339556319 tempest-TestVolumeBootPattern-339556319-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1958769818" status: 202 len: 0 microversion: 2.1 time: 0.026147 Jun 21 10:10:18.994318 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 589/1116] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Jun 21 10:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1958769818 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:10:19.629295 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:19.629915 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:19.636954 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:19.637403 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:19.638173 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:19.638608 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:19.781519 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:19.789385 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-51d4a154-3b3c-46cb-83c0-18e5935985ee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.163953 Jun 21 10:10:19.790061 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 528/1117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:19 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:20.807388 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:20.808980 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:20.818113 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:20.819201 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:20.820281 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:20.820959 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:21.016847 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:21.025514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e1810aa2-8126-4704-9950-709c7584ba4e tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.223739 Jun 21 10:10:21.026546 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 590/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:20 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:22.042825 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:22.044053 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:22.051561 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:22.052148 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:22.052920 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:22.053355 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:22.295693 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:22.319846 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dc4e32ee-4f8d-4f20-b7e2-7a95ba6d1689 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.281118 Jun 21 10:10:22.320450 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 529/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:22 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:23.337575 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:23.338351 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:23.345493 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:23.345941 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:23.346720 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:23.347151 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:23.369365 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:23.490961 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:23.499674 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-56465787-5437-4619-9273-9acbf25197b5 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.165891 Jun 21 10:10:23.500322 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 591/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:23 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:24.517840 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:24.526238 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:24.532939 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:24.533396 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:24.534178 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:24.534740 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:24.690402 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:24.703725 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8f03e86f-8f98-4f7e-b220-58096972b50d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.189732 Jun 21 10:10:24.709749 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 530/1121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:24 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:25.720470 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:25.721087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:25.727539 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:25.728005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:25.728813 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:25.729249 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:25.875095 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:25.884252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-98d02d7e-0b96-4602-b787-4906e6e52ab6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1509 microversion: 2.1 time: 0.167606 Jun 21 10:10:25.884825 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 592/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:25 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:25.901537 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:25.902116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:25.909266 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:25.909910 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:25.910941 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:25.911457 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:25.991312 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c8fd0aa7-3d07-4287-85dc-d71f7dd6e69d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "POST /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c/action" status: 202 len: 0 microversion: 2.1 time: 0.093250 Jun 21 10:10:25.992186 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 531/1123] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 21 10:10:25 2022] POST /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:10:26.000120 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:26.000814 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:26.007055 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:26.007543 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:26.008548 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:26.009157 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:26.153785 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:26.161446 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-55d6f99d-3e9e-43cf-aea1-b92f2495a1c9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1517 microversion: 2.1 time: 0.165180 Jun 21 10:10:26.162094 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 593/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:25 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:27.179959 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:27.180635 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:27.186567 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:27.187010 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:27.187762 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:27.188222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:27.317950 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:27.326159 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5495b3be-1852-4097-b52a-2f90943d4801 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1519 microversion: 2.1 time: 0.150656 Jun 21 10:10:27.326707 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 532/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:27 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:28.012585 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-583283c8-4c70-45ba-b315-707b75f77962 req-a31f599b-377b-48b5-9fd7-c5e6f5309c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "name": "network-vif-unplugged", "status": "completed", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:28.020708 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-583283c8-4c70-45ba-b315-707b75f77962 req-a31f599b-377b-48b5-9fd7-c5e6f5309c7f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:28.021153 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-583283c8-4c70-45ba-b315-707b75f77962 req-a31f599b-377b-48b5-9fd7-c5e6f5309c7f service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:28.032005 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-583283c8-4c70-45ba-b315-707b75f77962 req-a31f599b-377b-48b5-9fd7-c5e6f5309c7f service nova] Creating event network-vif-unplugged:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:10:28.036907 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-583283c8-4c70-45ba-b315-707b75f77962 req-a31f599b-377b-48b5-9fd7-c5e6f5309c7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167539 Jun 21 10:10:28.037481 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 594/1126] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:10:28.343402 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:28.344037 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:28.350680 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:28.351049 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:28.352395 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:28.352833 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:28.357077 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:28.561710 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:28.569499 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-29a763a6-2bda-4608-95f7-f7e1758e961f tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.229919 Jun 21 10:10:28.570065 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 533/1127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:28 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:29.587827 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:29.588538 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:29.594669 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:29.595114 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:29.595864 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:29.596325 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:29.727462 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:29.734893 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-29814ff0-9a6a-45f6-8132-b9802b413ea6 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.151791 Jun 21 10:10:29.735440 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 595/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:29 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:30.752590 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:30.753197 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:30.760178 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:30.760625 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:30.761382 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:30.761810 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:30.887618 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:30.895119 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f7ba9882-2f07-49f9-8a90-684e52b1cfa7 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.146384 Jun 21 10:10:30.895674 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 534/1129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:30 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:31.912656 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:31.913262 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:31.919901 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:31.920410 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:31.921178 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:31.921614 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:32.052236 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:32.060206 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-62a1e523-7fc7-4926-94b8-3eb8d7fbe861 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.151334 Jun 21 10:10:32.060769 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 596/1130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:31 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:33.077220 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:33.077830 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:33.084319 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:33.084767 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:33.085525 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:33.086583 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:33.213015 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:33.220422 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0bb46354-3e33-4377-9ca0-3cb422817199 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.147060 Jun 21 10:10:33.220971 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 535/1131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:33 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:33.504036 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:10:33.504240 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Tue Jun 21 10:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:10:34.237338 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:34.237957 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:34.244757 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:34.245208 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:34.245971 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:34.246410 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:34.372002 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:34.379514 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4fd581c3-a7d9-44e6-89f6-8faa09450bee tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.146108 Jun 21 10:10:34.380090 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 597/1132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:34 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:35.397226 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:35.397797 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:35.404153 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:35.404606 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:35.405369 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:35.405807 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:35.537933 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:35.546050 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-26fd819e-ba9d-4b2d-b550-9b2faea77670 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.152747 Jun 21 10:10:35.546599 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 536/1133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:35 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:36.562771 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:36.563382 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:36.565979 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:36.571919 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:36.572400 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:36.573167 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:36.573606 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:36.704569 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:36.712198 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-81f634a7-8e64-485d-bc43-1bb36df70474 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.153185 Jun 21 10:10:36.712828 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 598/1134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:36 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:37.729349 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:37.729956 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:37.732446 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:37.737966 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:37.738417 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:37.739181 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:37.739615 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:37.872003 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:37.879597 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-945f3dbb-f5bd-4b7e-bdd0-d2c08ad3c75c tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.154325 Jun 21 10:10:37.880158 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 537/1135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:37 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:38.897483 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:38.898646 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:38.905164 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:38.905609 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:38.906364 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:38.906794 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:39.034286 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:39.041693 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-05e516ba-65c3-4376-bc80-62f6c6b21d89 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.148188 Jun 21 10:10:39.042245 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 599/1136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:38 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:40.058441 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:40.059039 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:40.065617 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:40.066066 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:40.066823 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:40.067253 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:40.118948 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-a14916c1-6210-4376-8c52-8eb5b0b0e555 req-7a97b20b-37d5-47b0-a9fd-9571b92ac987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "name": "network-vif-plugged", "status": "completed", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:10:40.128264 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-a14916c1-6210-4376-8c52-8eb5b0b0e555 req-7a97b20b-37d5-47b0-a9fd-9571b92ac987 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:40.129064 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-a14916c1-6210-4376-8c52-8eb5b0b0e555 req-7a97b20b-37d5-47b0-a9fd-9571b92ac987 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:40.142724 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-a14916c1-6210-4376-8c52-8eb5b0b0e555 req-7a97b20b-37d5-47b0-a9fd-9571b92ac987 service nova] Creating event network-vif-plugged:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:10:40.147823 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-a14916c1-6210-4376-8c52-8eb5b0b0e555 req-7a97b20b-37d5-47b0-a9fd-9571b92ac987 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032787 Jun 21 10:10:40.149302 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 600/1137] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:10:40.212304 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:40.221007 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0e10e2c6-b67d-4552-938f-28b595c476f9 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.166453 Jun 21 10:10:40.221556 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 538/1138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:40 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:41.239457 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:41.240187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:41.246802 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:41.247252 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:41.248052 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:41.248524 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:41.380287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:41.388279 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9c839018-d2ba-4a00-a03c-e42dd22ad98b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1575 microversion: 2.1 time: 0.153468 Jun 21 10:10:41.388840 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 601/1139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:41 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:10:42.405717 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:10:42.406258 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:10:42.412806 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:42.413256 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:42.414016 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:10:42.414456 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:10:42.541075 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:10:42.548430 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3557ce08-dc8c-41a2-8c4d-507248c43706 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1562 microversion: 2.1 time: 0.146596 Jun 21 10:10:42.548975 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 539/1140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:10:42 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:12:02.152431 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=7 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:02.153192 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=54 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:02.157424 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:02.157701 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0ac09c84-ee0c-4323-83f8-ec834d7f8358 req-81e26435-f117-4db1-9102-194becde1016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:12:02.158117 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:12:02.161244 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=5 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:02.161895 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=40 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:02.165850 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:02.166306 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:02.167080 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:02.168347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:02.169233 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0ac09c84-ee0c-4323-83f8-ec834d7f8358 req-81e26435-f117-4db1-9102-194becde1016 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:02.169672 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0ac09c84-ee0c-4323-83f8-ec834d7f8358 req-81e26435-f117-4db1-9102-194becde1016 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:02.180402 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0ac09c84-ee0c-4323-83f8-ec834d7f8358 req-81e26435-f117-4db1-9102-194becde1016 service nova] Creating event network-changed:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:12:02.185646 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0ac09c84-ee0c-4323-83f8-ec834d7f8358 req-81e26435-f117-4db1-9102-194becde1016 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Jun 21 10:12:02.186241 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 540/1141] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:12:02.194347 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:12:02.273572 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9d89ceca-190a-4ddc-90a6-2161130252a8 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 204 len: 0 microversion: 2.1 time: 0.122969 Jun 21 10:12:02.274836 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 602/1142] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 21 10:12:02 2022] DELETE /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:12:02.284742 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:02.285470 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:12:02.292112 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:02.293304 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:02.294078 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:02.294511 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:02.433188 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:12:02.441679 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bfd4041c-527e-4164-8d36-92403d4c922d tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.161316 Jun 21 10:12:02.442620 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 541/1143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:12:02 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:12:03.460149 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:03.460777 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:12:03.467867 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:03.468336 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:03.469087 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:03.469521 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:03.596701 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:12:03.604685 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cda78d8d-8b28-4818-975f-1139e9262171 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1568 microversion: 2.1 time: 0.148802 Jun 21 10:12:03.614632 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 603/1144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:12:03 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:12:04.624425 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:04.625914 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:12:04.633222 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:04.633669 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:04.634495 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:04.634930 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:04.699995 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:12:04.708116 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c674977a-b576-4f08-ab3b-7ffaf8115d09 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1501 microversion: 2.1 time: 0.088963 Jun 21 10:12:04.708807 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 542/1145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:12:04 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1501 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:12:04.771631 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-8c81c589-35d3-4b9e-bc1b-63faa24eda70 req-28119e6d-c33f-42b2-a6dc-c36c13bc98b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0599c50-5a77-48d9-9d67-86684593c05c", "name": "network-vif-deleted", "tag": "29b27cf2-5b44-4819-a6fc-10192f355ad1"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:12:04.780187 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8c81c589-35d3-4b9e-bc1b-63faa24eda70 req-28119e6d-c33f-42b2-a6dc-c36c13bc98b4 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:04.780629 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8c81c589-35d3-4b9e-bc1b-63faa24eda70 req-28119e6d-c33f-42b2-a6dc-c36c13bc98b4 service nova] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:04.791387 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-8c81c589-35d3-4b9e-bc1b-63faa24eda70 req-28119e6d-c33f-42b2-a6dc-c36c13bc98b4 service nova] Creating event network-vif-deleted:29b27cf2-5b44-4819-a6fc-10192f355ad1 for instance c0599c50-5a77-48d9-9d67-86684593c05c on hv-cinder-80660 Jun 21 10:12:04.796756 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-8c81c589-35d3-4b9e-bc1b-63faa24eda70 req-28119e6d-c33f-42b2-a6dc-c36c13bc98b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028908 Jun 21 10:12:04.797356 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 604/1146] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 21 10:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:12:05.725163 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:05.725777 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:12:05.732356 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:05.732809 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:05.733573 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:05.734026 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:05.772001 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:05.772488 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:05.772926 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lazy-loading 'fault' on Instance uuid c0599c50-5a77-48d9-9d67-86684593c05c {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:12:05.817393 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f42593700cb41408d258257c652f5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff115ce08e947c29313f5019cf568fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:12:05.824989 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-035fb862-739d-420f-8625-1b64d8a1f10b tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 200 len: 1178 microversion: 2.1 time: 0.103637 Jun 21 10:12:05.825542 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 543/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:12:05 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 1178 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:12:06.843287 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:06.844003 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] [instance: c0599c50-5a77-48d9-9d67-86684593c05c] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:12:06.850180 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:06.850624 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:06.851384 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:12:06.851815 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Lock "12bd7c28-46c5-4e5d-900d-cb840c6e27b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:12:06.864829 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] HTTP exception thrown: Instance c0599c50-5a77-48d9-9d67-86684593c05c could not be found. Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Request method failure captured: Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c HTTP/1.1 Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Connection: close Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Host: 10.222.0.36 Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABisZhYRWr7-4uLiqk6xZop439gSMG7SjApljA2UYKcxOKIUO6IVsPB2MaUcTzAEKvbVWSZI-f-gama_M_91dZOJ34v9JT0_ZcqJMcaUk5D-N_Rpf8rG7RtUB-W4-7biU06i9Yf70WBWLT7Et4zAM103OyWDhTnIOW3ouMcYVGON4v52ao Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Id: dff115ce08e947c29313f5019cf568fd Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestShelveInstance-815667539 Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Role: reader,member Jun 21 10:12:06.866409 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Roles: reader,member Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dff115ce08e947c29313f5019cf568fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dff115ce08e947c29313f5019cf568fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dff115ce08e947c29313f5019cf568fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dff115ce08e947c29313f5019cf568fd"}]}] Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestShelveInstance-815667539 Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Id: dff115ce08e947c29313f5019cf568fd Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestShelveInstance-815667539 Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User: tempest-TestShelveInstance-815667539-project Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Id: 9f42593700cb41408d258257c652f5b7 Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestShelveInstance-815667539-project Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: method: > Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: exception: Instance c0599c50-5a77-48d9-9d67-86684593c05c could not be found. Jun 21 10:12:06.868486 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: action_args: {'id': 'c0599c50-5a77-48d9-9d67-86684593c05c'} Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0599c50-5a77-48d9-9d67-86684593c05c could not be found. Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:12:06.869604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0599c50-5a77-48d9-9d67-86684593c05c could not be found. Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0599c50-5a77-48d9-9d67-86684593c05c could not be found. Jun 21 10:12:06.871331 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 21 10:12:06.872899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Returning 404 to user: Instance c0599c50-5a77-48d9-9d67-86684593c05c could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:12:06.872899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f636b74e-35a9-4695-9f59-2839627044b3 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c" status: 404 len: 111 microversion: 2.1 time: 0.030046 Jun 21 10:12:06.872899 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 605/1148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 21 10:12:06 2022] GET /compute/v2.1/servers/c0599c50-5a77-48d9-9d67-86684593c05c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:12:07.025966 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c666485-3dd1-421e-b048-2ab8ad8f3615 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] Calling method '.version_select at 0x7f184aa635e0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:12:07.049254 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c666485-3dd1-421e-b048-2ab8ad8f3615 tempest-TestShelveInstance-815667539 tempest-TestShelveInstance-815667539-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-993543605" status: 202 len: 0 microversion: 2.1 time: 0.027067 Jun 21 10:12:07.050134 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 544/1149] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 21 10:12:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-993543605 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:12:21.168125 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:12:21.168613 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Tue Jun 21 10:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:14:11.540987 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:14:11.541528 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Tue Jun 21 10:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:14:24.828604 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:14:24.829174 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Tue Jun 21 10:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:15:31.917538 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:15:31.918111 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Tue Jun 21 10:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:15:41.176284 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:15:41.176765 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Tue Jun 21 10:15:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:15:42.483141 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:15:42.483750 dv-cinder-806605-4-iscsi devstack@n-api.service[117563]: Tue Jun 21 10:15:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:17:13.517295 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:17:13.517817 dv-cinder-806605-4-iscsi devstack@n-api.service[117564]: Tue Jun 21 10:17:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!